Making research materials Findable, Accessible, Interoperable and Reusable

Format
Poster
Date
8 March 2024
Event
AcqVA Aurora Closing Event, UiT The Arctic University of Norway

This presentation may have taken place at more events.
See list in Presentations.

Abstract

To err is human, but when it comes to creating research materials, mistakes can be reduced by sharing more of our work and by using some helpful tools. For instance, we can make our research materials FAIRer—that is, more Findable, Accessible, Interoperable and Reusable (Wilkinson et al., 2016). These practices facilitate the reproducibility, revision, modification and expansion of research materials, by the creators themselves and by other researchers, at any point in time, which is convenient due to the vital importance of methods in experimental research (Barsalou, 2019). In the current presentation, we describe how documentation practices and open-source software (namely, R and OpenSesame) were used to prepare materials for a study in multilingualism using artificial languages, and comprising several sessions and several grammatical properties. So far, the creation of artificial languages in similar studies has not generally displayed an extensive use of FAIR practices (Cross et al., 2021; González Alonso et al., 2020; Mitrofanova et al., 2023; Morgan-Short et al., 2012; Pereira Soares et al., 2022). In our current study, the stimuli were prepared in R using a modular framework that consisted of interoperable components (Snippet 1). The modularity of this method facilitates the expansion of the materials within the same languages and to other languages. Specifically, the minimal components of each language were contained in a base file in the ‘stimulus_preparation’ folder. Furthermore, for the creation of the final stimuli, several controls were exerted to prevent spurious effects. For instance, gender and number were counterbalanced across experimental conditions, words were rotated across grammatical properties and sessions, and frequency of occurrence was controlled (Snippet 2). The final stimuli can be recreated using the script ‘compile_all_stimuli.R’, and the resulting stimuli are saved to the ‘session_materials’ folder. Furthermore, the final stimuli were presented using OpenSesame, which is a free-of-charge software supporting experiments in the social sciences. We describe the implementation of several complex sessions in OpenSesame, which involved the use of conditions for controlling the engagement of certain items. Last, we describe a custom script in OpenSesame that enables the measurement of event-related potentials by time-locking electroencephalographic measures to the onset of specific stimuli. In conclusion, the materials of the current study are accessible, and the workflow is reproducible. As a result, the final materials are testable, modifiable and expandable, improving long-term efficiency.

 

Snippet 1

The use of code scripts facilitates the reproducibility, testability and expandability of materials.

└── stimulus_preparation
    ├── Norway site, base stimuli.csv
    ├── Spain site, base stimuli.csv
    ├── base_images.R
    ├── R_functions
    │   ├── Session2_Pretraining_vocabulary.R
    │   ├── Session2_Training_gender_agreement.R
    │   ├── Session2_Test_gender_agreement.R
    │   ├── Session2_Experiment_gender_agreement.R
    ...
    ├── compile_all_stimuli.R

Table 1

The minimal components of each language are contained in a base file.

verb_ID verb_type verb verb_contrast_ID
1 copula_be is
2 copula_be are
3 copula_look looks
4 copula_look look
5 transitive remembered A
6 transitive forgot A
7 transitive chose B
8 transitive refused B

Snippet 2

Tests were set throughout the workflow to control the frequency of some categories (R code).

columns_to_check = c('noun1_gender', 'number', 'person', 
                     'verb', 'noun1', 'wrapup_noun')

for(i in seq_along(columns_to_check)) {
  column = columns_to_check[i]
  number_of_unique_frequencies = 
    combinations %>% 
    filter(complete.cases(get(column)), get(column) != '') %>% 
    group_by(get(column)) %>% tally() %>% select(n) %>% 
    n_distinct()
  if(number_of_unique_frequencies != 1) {
    warning(paste0('Some elements in the column `', column, 
                   '` appear more often than others.'))
  }
}

Snippet 3

Seamless adjustment of parameters in each OpenSesame session (Python code).

participant_parameters = 
  pd.read_csv(exp.get_file('../parameters per participant/' + 
              var.study_site + 
              ' site, parameters per participant.csv'))

var.resting_state_order = 
  participant_parameters.loc[
    participant_parameters['participant'] ==
    var.subject_nr]['Session2_resting_state_order'].iloc[0]

var.language = 
  participant_parameters.loc[participant_parameters['participant'] == 
                             var.subject_nr]['language'].iloc[0]

Snippet 4

Sending serial-port triggers in OpenSesame to record ERPs (Python code).

# Open the first serial port available
serialport = serial.Serial(serial.tools.list_ports.comports()[0].device)

# Send triggers to the port
def send_trigger(trigger):
    serialport.write(trigger.to_bytes(length = 1, byteorder = 'big'))
    # 10 ms separation from next trigger (see BrainVision Recorder manual)
    time.sleep(0.01) 
    # reset port
    serialport.write(int(0).to_bytes(length = 1, byteorder = 'big')) 
    return;

References

Barsalou, L. W. (2019). Establishing generalizable mechanisms. Psychological Inquiry, 30(4), 220–230. https://doi.org/10.1080/1047840X.2019.1693857

Cross, Z. R., Zou-Williams, L., Wilkinson, E. M., Schlesewsky, M., & Bornkessel-Schlesewsky, I. (2021). Mini Pinyin: A modified miniature language for studying language learning and incremental sentence processing. Behavior Research Methods, 53(3), 1218–1239. https://doi.org/10.3758/s13428-020-01473-6

González Alonso, J., Alemán Bañón, J., DeLuca, V., Miller, D., Pereira Soares, S. M., Puig-Mayenco, E., Slaats, S., & Rothman, J. (2020). Event related potentials at initial exposure in third language acquisition: Implications from an artificial mini-grammar study. Journal of Neurolinguistics, 56, 100939. https://doi.org/10.1016/j.jneuroling.2020.100939

Mitrofanova, N., Leivada, E., & Westergaard, M. (2023). Crosslinguistic influence in L3 acquisition: Evidence from artificial language learning. Linguistic Approaches to Bilingualism, 13(5), 717-742. https://doi.org/10.1075/lab.22063.mit

Morgan-Short, K., Finger, I., Grey, S., & Ullman, M. T. (2012). Second language processing shows increased native-like neural responses after months of no exposure. PLOS ONE, 7(3), e32974. https://doi.org/10.1371/journal.pone.0032974

Pereira Soares, S. M., Kupisch, T., & Rothman, J. (2022). Testing potential transfer effects in heritage and adult L2 bilinguals acquiring a mini grammar as an additional language: An ERP approach. Brain Sciences, 12(5), Article 5. https://doi.org/10.3390/brainsci12050669

Wilkinson, M. D., Dumontier, M., Aalbersberg, Ij. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., Bouwman, J., Brookes, A. J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C. T., Finkers, R., … Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3(1), Article 1. https://doi.org/10.1038/sdata.2016.18

comments powered by Disqus