ORCID Profile
0000-0003-4868-2541
Current Organisations
Universität Wien
,
Australian National University
Does something not look right? The information on this page has been harvested from data sources that may not be up to date. We continue to work with information providers to improve coverage and quality. To report an issue, use the Feedback Form.
Publisher: SAGE Publications
Date: 11-2013
Abstract: This article examines the use of probing techniques in web surveys to identify validity problems of items. Conventional cognitive interviewing is usually based on small s le sizes and thus precludes quantifying the findings in a meaningful way or testing small or special subpopulations characterized by their response behavior. This article investigates probing in web surveys as a supplementary way to look at item validity. Data come from a web survey in which respondents were asked to give reasons for selecting a response category for a closed question. The web study was conducted in Germany, with respondents drawn from online panels ( n = 1,023). The usefulness of the proposed approach is shown by revealing validity problems with a gender ideology item.
Publisher: No publisher found
Date: 2015
DOI: 10.4232/1.12319
Publisher: SAGE Publications
Date: 03-12-2007
Abstract: To compare the effectiveness of different prenotification and invitation procedures in a web-based three-wave access panel survey over 3 consecutive months, we experimentally varied the contact mode in a fully crossed two-factorial design with (a) three different prenotification conditions (mobile short messaging service [SMS], e-mail, no prenotice) and (b) two “invitation and reminder” conditions (SMS, e-mail). A group with nearly complete mobile phone coverage was randomly assigned to one of these six experimental conditions. As expected, SMS prenotifications outperformed e-mail prenotifications in terms of response rates across all three waves. Furthermore, e-mail invitation response rates outperformed those for SMS invitations. The combination of SMS prenotification and e-mail invitation performed best. The different experimental treatments did not have an effect on the s le composition of respondents between groups.
Publisher: Springer Fachmedien Wiesbaden
Date: 2018
Publisher: SAGE Publications
Date: 03-04-2012
Abstract: Cognitive interviewing is a well-established method for evaluating and improving a questionnaire prior to fielding. However, its present implementation brings with it some challenges, notably in terms of small s le sizes or the possibility of interviewer effects. In this study, the authors test web surveys through nonprobability online panels as a supplemental means to implement cognitive interviewing techniques. The overall goal is to tackle the above-mentioned challenges. The focus in this article is on methodological features that pave the way for an eventual successful implementation of category-selection probing in web surveys. The study reports on the results of 1,023 respondents from Germany. In order to identify implementation features that lead to a high number of meaningful answers, the authors explore the effects of (1) different panels, (2) different probing variants, and (3) different numbers of preceding probes on answer quality. The overall results suggest that category-selection probing can indeed be implemented in web surveys. Using data from two panels—a community panel where members can actively get involved, for ex le, by creating their own polls, and a “conventional” panel where answering surveys is the members' only activity—the authors find that high community involvement does not increase the likelihood to answer probes or produce longer statements. Testing three probing variants that differ in wording and provided context, the authors find that presenting the context of the probe (i.e., the probed item and the respondent’s answer) produces a higher number of meaningful answers. Finally, the likelihood to answer a probe decreases with the number of preceding probes. However, the word count of those who eventually answer the probes slightly increases with an increasing number of probes.
Publisher: Oxford University Press (OUP)
Date: 2013
DOI: 10.1093/POQ/NFU033
Publisher: No publisher found
Date: 2013
DOI: 10.4232/1.11560
Publisher: No publisher found
Date: 2014
DOI: 10.4232/1.11573
Publisher: Wiley
Date: 20-08-2009
DOI: 10.1002/ACP.1602
Publisher: No publisher found
Date: 2014
DOI: 10.4232/1.11572
Publisher: Wiley
Date: 18-12-2020
Publisher: No publisher found
Date: 2014
DOI: 10.4232/1.11575
Publisher: No publisher found
Date: 2015
DOI: 10.4232/1.11574
Publisher: No publisher found
Date: 2014
DOI: 10.4232/1.11577
Publisher: SAGE Publications
Date: 24-03-2014
Abstract: The literature on human-computer interaction consistently stresses the importance of reducing the cognitive effort required by users who interact with a computer in order to improve the experience and enhance usability and comprehension. Applying this perspective to web surveys, questionnaire designers are advised to strive for layouts that facilitate the response process and reduce the effort required to select an answer. In this article, we examine whether placing the answer boxes (i.e., radio buttons or check boxes) to the left or to the right of the answer options in closed questions with vertically arranged response categories enhances usability and facilitates responding. First, we discuss a set of opposing principles of how respondents may process these types of questions in web surveys, some suggesting placing the answer boxes to the left and others suggesting placing them to the right side of the answer options. Second, we report an eye-tracking experiment that examined whether web survey responding is best described by one or another of these principles, and consequently whether one of the three layouts is preferable in terms of usability: (1) answer boxes to the left of left-aligned answer options, (2) answer boxes to the right of left-aligned answer options, and (3) answer boxes to the right of right-aligned answer options. Our results indicate that the majority of respondents conform to a principle suggesting placing the answer boxes to the left of left-aligned answer options. Moreover, respondents require less cognitive effort (operationalized by response latencies, fixation times, fixation counts, and number of gaze switches between answer options and answer boxes) to select an answer in this layout.
Publisher: No publisher found
Date: 2014
DOI: 10.4232/1.11576
Publisher: Springer Science and Business Media LLC
Date: 10-08-2014
Publisher: SAGE Publications
Date: 23-10-2013
Abstract: Two formats of labeling in rating scales are commonly used in questionnaires: verbal labels for end categories only (END form) and verbal labels for each of the categories (ALL form). We examine attention processes and respondents’ burden in using verbal labels in rating scales. Attention was tracked in a laboratory setting employing eye-tracking technology. The results of the two experiments are presented: One applied seven and the other applied five categories in rating scales comparing END and ALL forms ( n = 47 in each experiment). The results show that the ALL form provides higher reliability, although the probability that respondents attend to a verbal label seems to decrease as the number of verbally labeled categories increases.
Publisher: Walter de Gruyter GmbH
Date: 21-02-2017
Abstract: Occupation coding, an important task in official statistics, refers to coding a respondent’s text answer into one of many hundreds of occupation codes. To date, occupation coding is still at least partially conducted manually, at great expense. We propose three methods for automatic coding: combining separate models for the detailed occupation codes and for aggregate occupation codes, a hybrid method that combines a duplicate-based approach with a statistical learning algorithm, and a modified nearest neighbor approach. Using data from the German General Social Survey (ALLBUS), we show that the proposed methods improve on both the coding accuracy of the underlying statistical learning algorithm and the coding accuracy of duplicates where duplicates exist. Further, we find defining duplicates based on ngram variables (a concept from text mining) is preferable to one based on exact string matches.
Publisher: No publisher found
Date: 2019
DOI: 10.11587/VOSVGK
Publisher: SAGE Publications
Date: 29-01-2013
Abstract: We report s le composition discrepancies related to demographic and personality variables occurring in different stages of development of a probability-based online panel. The first stage—selecting eligible participants—produces differences between Internet users and nonusers in age, education, and gender distribution as well as in the personality traits of openness to experience, conscientiousness, and extraversion. The second and third stages of panel development—asking about willingness to participate in the panel and actual participation in online surveys—result in fewer and smaller discrepancies. The results suggest that among the three potential sources of s le composition bias considered, the largest impact comes from coverage differences with regard to Internet access.
Publisher: Oxford University Press (OUP)
Date: 29-07-2011
DOI: 10.1093/IJPOR/EDQ053
Publisher: Oxford University Press (OUP)
Date: 25-10-2013
DOI: 10.1093/IJPOR/EDS034
Publisher: German Medical Science GMS Publishing House
Date: 2012
DOI: 10.3205/MBI000240
Publisher: Zenodo
Date: 2020
Publisher: SAGE Publications
Date: 17-04-2014
Abstract: In this study, we explore to what extent the visual presentation of open-ended probes, in connection with different prior probing exposure, impacts on response quality. We experiment with two text box sizes for a specific immigrant probe ( Which type of immigrants were you thinking of when you answered the question?). On the one hand, we use a standard size equal to the other text box sizes in the survey but oversized for the specific response task. On the other hand, we use a smaller text box which fits the response task. The other probes in the survey that use the standard text box are mainly category-selection probes that ask for a reasoning for the chosen answer value. Due to randomized rotation of questions, respondents receive different numbers of category-selection probes prior to the immigrant probe, resulting in different degrees of exposure to category-selection probing prior to the immigrant probe. For the immigrant probe, we find that respondents who receive the standard text box and who have had a high exposure to category-selection probing are more likely to provide mismatching answers: The mismatch consists of not answering the specific immigrant probe but rather providing a reasoning answer as typically expected for a category-selection probe. Thus, previous experience with probing in the questionnaire can override the actual probe wording. This problem can be minimized by considering possible carryover effects of prior probes and using an appropriate survey design strategy.
Publisher: methods, data, analyses
Date: 2015
Publisher: No publisher found
Date: 2014
DOI: 10.4232/1.11571
Publisher: Foundation for Open Access Statistic
Date: 2020
Publisher: No publisher found
Date: 2014
DOI: 10.4232/1.11570
No related grants have been discovered for Lars Kaczmirek.