Methodological and Epistemological Aspects of Online Writing Studies from a Cognitive Perspective

Authors

  • María de los Ángeles Chimenti Consejo Nacional de Investigaciones Científicas y Técnicas, Centro Interdisciplinario de Investigaciones en Psicología Matemática y Experimental, Instituto Tecnológico de Buenos Aires https://orcid.org/0000-0002-5709-3696

DOI:

https://doi.org/10.48162/rev.57.025

Keywords:

writing, online measures, think aloud, key-stroke logging, triple task

Abstract

This paper examines the methodological aspects and epistemological commitments involved in the online study of writing processes at the textual level. We critically review six studies that investigate the relationships between the temporal distribution of production processes and sub-processes and the characteristics of texts as linguistic products. Specifically, the analysis focuses on four dimensions: sample definition, task characteristics, variable operationalization, and experimental techniques. Additionally, we consider the explicitness of methodological decisions, the completeness of design reporting, and the consideration of epistemological aspects related to each technique. The analysis highlights the need to triangulate data from different experimental techniques when studying text production processes. Given that online writing studies are underrepresented in psycholinguistic research in Latin America, this paper aims to contribute to the development of consistent and robust experimental designs.

Downloads

Download data is not yet available.

Author Biography

María de los Ángeles Chimenti, Consejo Nacional de Investigaciones Científicas y Técnicas, Centro Interdisciplinario de Investigaciones en Psicología Matemática y Experimental, Instituto Tecnológico de Buenos Aires

Doctora en Lingüística por la Universidad de Buenos Aires (UBA), licenciada y profesora en Letras por la Universidad de Buenos Aires (UBA) y especialista en Lectura, Escritura y Educación por la Facultad Latinoamericana de Ciencias Sociales (FLACSO). Actualmente es profesora en el Instituto Tecnológico de Buenos Aires (ITBA) y becaria posdoctoral del Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET). Su investigación se centra en la evaluación de las habilidades de escritura en la escuela secundaria. Es editora asociada de la sección latinoamericana de la serie International Exchanges on the Study of Writing de WAC Clearinghouse.

References

Abbhul, R., Gass, S. & Mackey, A. (2014). Experimental research design. En R. Podesva y D. Sharma (Eds.), Research Methods in Linguistics (pp. 116-134). Cambridge University Press.

Aguirre, L. A. (2015). Acercamiento al análisis pausológico del proceso de producción escrita mediante la técnica keystroke logging. Lingüística, 31(1), 81-91. http://www.scielo.edu.uy/pdf/ling/v31n1/v31n1a06.pdf

Aguirre, L. A. & Negri, S. (2019). Proceso de revisión y calidad del producto textual. En D. Riestra y N. Múgica (Eds.), Estudios SAEL 2019 (pp. 183-196). Editorial de la Universidad Nacional del Sur.

Aguirre, L. A., Negri, S. & López Galdós, M. (2018). Dinámica temporal de la revisión durante la escritura de reseñas en la universidad. Traslaciones: Revista Latinoamericana de Lectura y Escritura, 5(10), 192-211.

https://revistas.uncu.edu.ar/ojs3/index.php/traslaciones/article/view/1626

Alamargot, D., Chesnet, D. & Caporossi, G. (2012). Using eye and pen movements to study the writing process. En M. Fayol, D. Alamargot y V. Berninger (Eds.), Translation of thought to written text while composing: Advancing theory, knowledge, research methods, tools, and applications (pp. 315-338). Taylor & Francis.

Alamargot, D., Chesnet, D., Dansac, C. & Ros, C. (2006). Eye and pen: A new device for studying reading during writing. Behavior Research Methods, 38(2), 287–299. https://doi.org/10.3758/BF03192780

Álvarez-Fernández, M. L. & García-Sánchez, J. N. (2015). The orchestration of processes in relation to the product, and the role of psychological variables in written composition. Anales de Psicología/Annals of Psychology, 31(1), 96-108. https://doi.org/10.6018/analesps.31.1.169621

Alves, R. A., Castro, S. L., de Sousa, L. & Stromqvist, S. (2007). Influence of keyboarding skill on pause- execution cycles in written composition. En M. Torrance, L. van Waes y D. Galbraith (Eds.), Writing and cognition: Research and applications (pp. 55–65). Elsevier.

Arunachalam, S. (2013). Experimental methods for linguists. Language and Linguistics Compass, 7(4), 221–232. https://doi.org/10.1111/lnc3.12021

Barkaoui, K. (2019). What can L2 writers’ pausing behavior tell us about their L2 writing processes?. Studies in Second Language Acquisition, 41(3), 529-554. https://doi.org/10.1017/S027226311900010X

Barton, D. & Hamilton, M. (2000). Literacy practices. En D. Barton, M. Hamilton y R. Ivanič (Eds.), Situated literacies. Reading and writing in context (pp. 7-15). Routledge.

Bazerman, C. (2016). What do sociocultural studies of writing tell us about learning to write?. En Ch. A. MacArthur, S. Graham y J. Fitzgerald (Eds.), Handbook of Writing Research, (pp. 11-23). The Guilford Press.

Bazerman, C., Graham, S., Applebee, A. N., Matsuda, P. K., Berninger, V. W., Murphy, S., Brandt, D., Wells Rowe, D. & Schleppegrell, M. (2017). Taking the long view on writing development. Research in the Teaching of English, 51(3), 351-360. https://doi.org/10.58680/rte201728980

Beauvais, C., Olive, T. & Passerault, J. M. (2011). Why are some texts good and others not? Relationship between text quality and management of the writing processes. Journal of Educational Psychology, 103, 415–428. https://doi.org/10.1037/a0022545

Bereiter, C. & Scardamalia, M. (1987/2013). The Psychology of Written Composition. Routledge.

Breetvelt, I., Van den Bergh, H. & Rijlaarsdam, G. (1994). Relations between writing processes and text quality: When and how?. Cognition and Instruction, 12, 103-123. https://doi.org/10.1207/s1532690xci1202_2

Canz, T., Hoffmann, L., & Kania, R. (2020). Presentation-mode effects in large-scale writing assessments. Assessing Writing, 45, 100470. https://doi.org/10.1016/j.asw.2020.100470

Castorina, J. A. (2013). Algunos problemas epistemológicos en la investigación psicológica. En V Congreso Internacional de Investigación y Práctica Profesional en la Facultad de Psicología. Universidad de Buenos Aires.

Cuetos, F. (2009). Psicología de la escritura. Wolters Kluwer.

Figueroa-Leighton, A. & Crespo, N. (2022). Caracterización del proceso de escritura de niños y preadolescentes de DT y TDL: Aplicación de la técnica Eye and Pen. Revista signos, 55(110), 976-1000. http://dx.doi.org/10.4067/S0718-09342022000300976

Galbraith, D. & Vedder, I. (2019). Methodological advances in investigating L2 writing processes. Studies in Second Language Acquisition, 41, 633-645. https://doi.org/10.1017/S0272263119000366

González Lamas, J. (2015). Argumentar a partir de fuentes: Diseño y evaluación de un programa para mejorar la escritura de síntesis argumentativas en educación secundaria. [Tesis de doctorado]. Universidad Autónoma de Madrid. http://hdl.handle.net/10486/669671

Hacker, D. J., Keener, M. C. & Kircher, J. C. (2017). TRAKTEXT: Investigating writing processes using eye-tracking technology. Methodological Innovations, 10(2), 1-18. https://doi.org/10.1177/2059799116689574

Hayes, J. (2012). Modeling and remodeling writing. Written Communication, 23(2), 369-388. https://doi.org/10.1177/0741088312451260

Hayes, J. & Berninger, V. (2014). Cognitive process in writing: A framework. En B. Arfé, J.E. Dockrell y V. Berninger (Eds.), Writing development in children with hearing loss, dyslexia or oral language problems: Implications for assessment and instruction (pp. 3–15). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199827282.003.0001

Hayes, J. & Flower, L. (1980). Identifying the organization of writing processes. En L. W. Gregg y E. R. Steinberg (Eds.), Cognitive processes in writing (pp. 3-30). Lawrence Erlbaum.

Henrich, J., Heine, S. J. & Norenzayan, A. (2010). Most people are not WEIRD. Nature, 466(7302), 29. https://doi.org/10.1038/466029a

Hernández-Sampieri, R. & Mendoza Torres, C. P. (2018). Metodología de la investigación: las rutas cuantitativa, cualitativa y mixta. McGraw Hill Education.

Irrazábal, N. & Molinari Marotto, C. (2005). Técnicas experimentales en la investigación de la comprensión de lenguaje. Revista Latinoamericana de Psicología, 37 (3), 581-594.

Leijten, M. & van Waes, L. (2013). Key-stroke logging in writing research: using Inputlog to analyze and visualize writing processes. Written Communication, 30(3), 358-392. https://doi.org/10.1177/0741088313491692

Levy, C. M. & Olive, T. (2002). Real time studies in writing research: progress and prospects. En T. Olive y C. M. Levy (Eds.), Contemporary tools and techniques for studying writing (pp. 1-8). Springer Science. https://doi.org/10.1007/978-94-010-0468-8_1

Limpo, T. & Alves, R. A. (2018). Effects of planning strategies on writing dynamics and final texts. Acta Psychologica, 188, 97-109. https://doi.org/10.1016/j.actpsy.2018.06.001

Limpo, L., Nunes, A. & Coelho, A. (2020). Introduction to the special issue on technology-based writing instruction: A collection of effective tools. Journal of Writing Research, 12(1), 1-7. https://doi.org/10.17239/jowr-2020.12.01.01

López-Gutiérrez, P. (2019). Component analysis of strategy instruction in writing composition: evaluation and instruction. [Tesis de doctorado]. Universidad de León. http://hdl.handle.net/10612/11582

López, P. & Fidalgo, R. (2018). Análisis de pausas y ejecuciones para el estudio de procesos de escritura. International Journal of Developmental and Educational Psychology, 2(1), 261-268. http://dx.doi.org/10.17060/ijodaep.2018.n1.v2.1222

López, P., Torrance, M. & Fidalgo, R. (2019). The online management of writing processes and their contribution to text quality in upper-primary students. Psicothema: Revista de Psicologia, 31(3), 311-318.

https://doi.org/10.7334/psicothema2018.326

MacArthur, C. & Graham, S. (2016). Writing research from a cognitive perspective. En Ch. MacArthur, S. Graham y J. Fitzgerald (Eds.), Handbook of Writing Research (pp. 24-40). The Guilford Press.

MacArthur, Ch. A., Graham, S., & Fitzgerald, J. (2016). Handbook of Writing Research. The Guilford Press.

Martínez Hincapié, J. (2013). La investigación experimental en lingüística. Katharsis, 15, 215-238. https://revistas.iue.edu.co/index.php/katharsis/article/view/246

McCutchen, D., Teske, P., & Bankston, C. (2008). Writing and cognition: Implications of the cognitive architecture for learning to write and writing to learn. En C. Bazerman (Ed.), Handbook of research on writing (pp. 554-578). Taylor & Francis Group.

Mertins, B. (2016). The use of experimental methods in linguistic research: advantages, problems and possible pitfalls. En T. Anstatt, A. Gattnar y C. Clasmeier (Eds.), Slavic Languages in Psycholinguistics. Chances and Challenges for Experimental Research (pp. 15-33). Francke Atempo.

Miranda, A. (2019). Desarrollo de la escritura en español: un estudio psicolingüístico. [Tesis doctoral]. Universidad de Buenos Aires. http://repositorio.filo.uba.ar/handle/filodigital/11287

Miranda, A., Abusamra, V. & Pan, S. (2020). La escritura: una habilidad lingüística cultural. En V. Abusamra, A. Miranda, R. Cartoceti, M. Difalcis, A. Re, C. Cornoldi, Batería para la Evaluación de la Escritura - BEEsc (pp. 17-33). Paidós.

Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine, 151(4), 264-269. https://doi.org/10.1016/j.ijsu.2010.02.007

Montero, O. & León, O. G. (2007). A guide for naming research studies in Psychology. International Journal of clinical and Health psychology, 7(3), 847-862.

Moreau, D. & Gamble, B. (2022). Conducting a meta-analysis in the age of open science: Tools, tips, and practical recommendations. Psychological Methods, 27(3), 426. https://doi.org/10.1037/met0000351

Navarro, F., Ávila-Reyes, N. & Gómez Vera, G. (2019). Validez y justicia: hacia una evaluación significativa en pruebas estandarizadas de escritura. Meta: Avaliação, 11(31), 1-35. http://dx.doi.org/10.22347/2175-2753v11i31.2045

Olive, T. (2010). Methods, techniques, and tools for the on-line study of the writing process. En N. I. Mertens (Ed.), Writing: processes, tools and techniques (pp. 1-18). Nova Science Publishers.

Olive, T., Kellogg, R. T. & Piolat, A. (2002). The triple task technique for studying the process of writing. En T. Olive y C. M. Levy (Eds.), Contemporary tools and techniques for studying writing (pp. 31-59). Springer Science. https://doi.org/10.1007/978-94-010-0468-8_3

Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-

Wilson, E., McDonald, S. & Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. International Journal of Surgery, 88, 105906. https://doi.org/10.1016/j.ijsu.2021.105906

Révész, A. & Michel, M. (2019). Introduction to the special issue. Studies in Second Language Acquisition, 41, 491-501. https://doi.org/10.1017/S0272263119000329

Révész, A., Michel, M. & Lee, M. (2019). Exploring second language writers’ pausing and revision behaviors: a mixed methods study. Studies in Second Language Acquisition, 41, 605-631. https://doi.org/10.1017/S027226311900024X

Saussure, F. (1996/2012). Curso de lingüística general. Losada.

Tannert, M. (2021). Computing numerical images of student writing: perspectives from educational research. Scandinavian Studies in Language, 12(1), 1-29. https://doi.org/10.7146/sss.v12i1.130066

ten Peze, A., Janssen, T., Rijlaarsdam, G. & Van Weijen, D. (2021). Writing creative and argumentative texts: What's the difference? Exploring how task type affects students' writing behaviour and performance. L1-Educational Studies in Language and Literature, 21, 1-38. https://doi.org/10.17239/L1ESLL-2021.21.01.11

Valenzuela, Á. (2020). Explorando las dinámicas temporales en la escritura de integración. Lenguas Modernas, (56), 43-61. https://lenguasmodernas.uchile.cl/index.php/LM/article/view/61509

Valenzuela, Á. (2022). ¿Escribo siempre igual? Efectos de los propósitos comunicativos de las tareas en la organización temporal durante el proceso de escritura. Revista signos, 55(110), 873-897. http://dx.doi.org/10.4067/S0718-09342022000300873

Valenzuela, Á. & Castillo, R.D. (2022). The effect of communicative purpose and reading medium on pauses during different phases of the textualization process. Reading and Writing, 36, 881-908. https://doi.org/10.1007/s11145-022-10309-y

van den Bergh, H. & Rijlaarsdam, G. (2001). Changes in cognitive activities during the writing process and relationships with text quality. Educational Psychology, 21(4), 373-385. https://doi.org/10.1080/01443410120090777

Wengelin, Å., Frid, J., Johansson, R. & Johansson, V. (2019). Combining keystroke logging with other methods: Towards an experimental environment for writing process research. En E. Lindgren y K. Sullivan (Eds.), Observing Writing (pp. 30-49). Brill. https://doi.org/10.1163/9789004392526_003

Published

19-06-2026

How to Cite

Chimenti, M. de los Ángeles. (2026). Methodological and Epistemological Aspects of Online Writing Studies from a Cognitive Perspective. Anales De Lingüística, (16), 13-38. https://doi.org/10.48162/rev.57.025

Issue

Section

Article