Wendy Arnold
STT 221W
01 Nov 2016
Project: Article Review
Aggregate Exchange-Level Demographic Data Can Be Used To Adjust for
Non-Resolvability In Telephone Surveys
Williams, Stephen, and Ronghua Cathy Lu. "Using Telephone Exchange-Level Data To Adjust For Non-Response: Application In An Establishment Survey.” ASA Section on Survey Research Methods, pp. 3847-3854, Published by American Statistical Association. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.494.7518&rep=rep1&type=pdf Accessed 01 Nov. 2016.
Introduction
Traditional procedures for conducting telephone surveys are challenged in today’s world by the popular use of call-blocking and screening services. Problems arise in determining if a telephone number is linked to a sample unit eligible for participation and also in completing interviews with participants. Researchers seek to revise survey methods and find ways to adjust for non-response and the increasing rate of unknown eligibility in telephone surveys. In “Using Telephone Exchange-Level Data to Adjust For Non-Response: Application in An Establishment Survey,” Williams and Lu suggested using household demographic summary information at the telephone exchange level to decrease non-response bias and increase accuracy in establishment survey results (Williams and Lu 3847).
Purpose of the study
The purpose of this study was to reduce bias in the results of a telephone survey of post-secondary education establishments by finding solutions to the
(4). Using survey techniques that confuse respondents or bias their answers, but not revealing the questions and interview procedure.
conducted a rolling survey similar to the one conducted in New Jersey. The survey enabled
The population is undergraduate students of UM and we eliminated the unsuitable sample based on the information of questionnaires (exclude the outliers, blank questionnaire, context is contradictory and so on). Then we selected 30 questionnaires per college year which year 1 to year 4 (30*4=120) from all the completed questionnaires. We used convenience sampling method to distribute the online questionnaires openly. And we received the completed questionnaires online which are from google form.
Coverage error, the failure to give some persons in a target population a chance to be selected into the sample, was present in the survey because insecure areas were not represented. The survey attempted to mitigate coverage errors by conducting face to face interviews to eliminate the coverage bias introduced by phone interviews. The response rate was not reported in the methodology page. However, if the response rate was 25%, that would indicate that the 1,000-sample size was taken from 4,000 individuals. Whether response rate affects data quality is a matter of debate, yet, according to Hillygus, “multiple studies have found that lower response rates do not indicate the results are inaccurate” (Hillygus 42). The role response rates have on the accuracy of results is uncertain, but inclusion of it provides insight into the quality of the methods.
Internal validity of this study included data collection process and student personal interest in education. For example, students may have scored in exam because they concern about their own education. Reliability of this study instrument has not been tested. This is the first time this group will have this survey. There is no former survey to use as a standard to see if there are many changes.
Also cost effective, the mail surveys specifically targeted the members and their spouses. Postal surveys can target specific people (necessary for the member and spouse data collection), and allow respondents the ability to answer the survey at their leisure. On the other hand, mail questionnaires are a slower data gathering method as compared to internet surveys (Hoonakker & Carayon, 2009, p. 359). Similarly, the possibility of response-based error may occur if respondents do not correctly
The two surveys utilized data from the National Annenberg Election Study. The data was retrieved using Internet and telephone collection methods. An advantage to this method was the utilization of two pools of sampling. The pools were each collected from the Internet, and one telephone. Also, the author used already available data. This significantly reduced the time and financial strain that a survey could take up. The sample was collected through random digit dialing and availability to the Internet. This adds to the reliability of the results. Traditional phone surveys use a set list of phone numbers. This would exclude those who have private or unlisted numbers. This problem is avoided with random digit dialing. The surveys were conducted during four different waves. The waves were from winter, spring, summer, and fall waves. The winter wave resulted in 19,190 respondents. The spring wave resulted in 17, 747 interviews. The summer wave included 20,052 interviews. The fall wave resulted in 19,241 respondents. To be
Data collected from research already conducted will be analyzed for limitations and to conduct a comparative analysis of the results. The survey completed by classmates will be used to collect
Those who agreed to participate in the survey had to option to take it over the phone or have the survey emailed to them.
Sampling is a method by which one can gain an estimation of accuracy for population (Jaggia & Kelly, 2014). Surveying is a form of sampling which is often used to provide an estimate. A survey was conducted on a group of people living in New York City which consisted of 445 randomly selected people from multiple boroughs on a monthly basis for six months. The survey focused on the boroughs of Manhattan, Brooklyn, Queens, The Bronx, and Staten Island. Additionally, demographic information was collected, including level of education and marital status. This paper will provide the results of the survey as well as their accuracy of the estimates in order for the New York City governmental agency personnel.
Also, those 22 subjects have limited time or different time schedules that would make it difficult to participate in the study because they are currently full-time or part-time internship advisors at universities. In this situation, a quantitative research method is more appropriate to reach participants and collect their responses because this type of research is not necessary to measure their various opinions or thoughts. Instead, it requires a deductive approach, in which researchers design a pre-constructed standardized instrument or pre-determined response categories prior to the distribution of questionnaire and measure the responses of participants to a restricted set of questions (Yilmaz, 2013). Those pre-determined questionnaires will be beneficial for both participants and researchers. Participants can save time to complete the questions, and they are relatively easy to
The methodology was described with the data collection method. Quantitative and qualitative questionnaire which consisted of closed questions with a choice of fixed answers and free text to enhance qualitative data were sent out in the form of mailshot, followed by telephone call to non-respondents and it was repeated for more wider sample results to gain more evidence to reduce bias (Parahoo, 2006).
To improve “sampling representativeness” a “proportional stratified sample” will be done to determine how many surveys to send to each city (Clemons & McBeth, 2001, p. 277). The formula will calculate the population of each city in 2010 and divide it by the total population of the ten cities to come up with a percentage. That percentage is multiplied by 2,000 to determine the number of surveys each community will receive and is available for review in Appendix II. COMPASS will then work with member cities and randomly select households through the use of “systematic random sampling” by dividing each city’s population by the number of surveys it receives for the survey (Clemons & McBeth, 2001, p.
Sampling is reduced for all the smallest sampling starting at (SEMOS ≤ 800) each year with the increasing addresses. Sample testing rates remain at 15%, 10%, and 7 % the sampling rates include strata for blocks in certain census so that the surveys can have the highest rates of completed questioners. Surveys are conducted by mail and a follow up telephone call by Computer Assisted Telephone Interviewing (CATI). CATI interviews have a 60% and mailing addresses have a 75% response. All data is collected by Internet, mail, telephone, and personal visit according to the ACS Survey report. (ACS methodology data report)
You have solid strengths in your work this week. You provided detail in answering the question. Economically, telephone surveys are a fantastic method to collect data considering 94 percent of household have telephone access (Cooper & Schindler, 2014, p. 234). Your point concerning the verbatim usage of the question set is very interesting. However, telephone surveys have a limit considering the participant must voluntarily answer the question set.