The mystery shopper: an anonymous review of your services

K Steiner

Abstract:Mystery shoppers can provide an unbiased report on the day-to-day functioning of hospital activities. For this study, six shoppers "used" various hospital services and reported their impressions through a questionnaire. The general findings may be applicable to many other well-run health care organizations.

What problem does this paper attempt to address?

The mystery shopper: a tool to measure public service delivery?

Steve Jacob,Nathalie Schiffino,Benjamin Biard

DOI: https://doi.org/10.1177/0020852315618018

IF: 2.397

2016-03-14

International Review of Administrative Sciences

Abstract:Originally the exclusive preserve of the private sector, the mystery shopper technique is increasingly being used in the public sector. In the wake of the reforms to modernise the state, accountability and performance-monitoring exercises are on the rise. They focus, in particular, on service quality and user-customer satisfaction. The article makes a twofold contribution to this topic: methodological and substantive. First of all, the article undertakes a scoping review of the literature on the mystery shopper. This review makes it possible to present the mystery shopper technique and its use in the public sector. For this bibliometric study, a sample of 34 papers was analysed. Second, the article offers a summary of the research into the mystery shopper technique, its potential and its limitations. Points for practitioners This article describes the use of the mystery shopper technique in the public sector. The areas for which mystery shopper surveys are commissioned are relatively limited, most being undertaken in the health sector. However, the scoping review emphasises the potential importance of mystery shopping for the purposes of the evaluation. As such, investigating other areas can be very interesting and promising for the public authorities. We also observe from this literature review that the challenges identified during mystery shopper studies can be overcome.

public administration
Shopping bad service

Catharine Sadler

DOI: https://doi.org/10.7748/ns.24.50.20.s25

Abstract:Mystery shoppers are well established in the retail trade. But their introduction to health services--particularly in mental health--raises ethical issues.
Mystery shopping as a quality adjunct in public health organizations

R Hartley

Abstract:Public health in Australia is undergoing unprecedented emphasis on meeting customers' needs, wants and expectations. Mystery shopping, common in the commercial world, has much to offer health organizations in their push towards quality. This paper describes this inexpensive technique and reports on its use in North West Health Service, a large rural health provider. The potential exists for its widescale adoption in health to better meet customer focus objectives.
Mystery patient insight into clinical laboratory service

John O'Malley

Abstract:Gone are the days when most patients tolerated impersonal service from their physicians and health-care providers in general. Every day, customer and patient satisfaction becomes more critical to a health-care provider's success and survival. Open communications, Internet-informed patients, and aggressive watch groups reveal those health-care providers who consistently deliver poor service. Most health-care providers employ patient satisfaction surveys to monitor their level of service; however, written and telephone surveys seldom provide the surveyor the insight necessary to provide differentiating service because of a large illiteracy rate and fear of reprisal. Toward this end, a well-trained mystery patients offers the health-care provider greater insight into how service is dispensed to its customers and patients. This article offers an aggregate of mystery patient insights into delivering clinical laboratory services both in hospital and medical practice environments, supported with insightful information into creating winning service strategies.
Mystery shopping: A tool to develop insight into customer service provision

Ton Van der Wiele,Martin Hesselink,Jos Van Iwaarden

DOI: https://doi.org/10.1080/14783360500078433

2005-06-01

Abstract:Reaching service excellence through a focus on the customer, demands more than just measuring customer satisfaction by means of questionnaire surveys. Nowadays, it is not sufficient anymore to have service excellence in services, processes and relationships. Now is the time to create excellence in customer experiences, as the only way to create competitive advantage in the market. Organizational change should then be driven by a broader focus on customers' expectations and multiple ways of measuring customers' satisfaction. The case of a service company in The Netherlands (a temporary employment agency) illustrates the way to service excellence as an organizational change process. The case supports the need for a broad focus on measurements in order to be able to monitor and to direct organizational changes. Customer satisfaction data based on surveys are needed; however, they will not be sufficient for continuing the change process over time. To achieve that, other measurements, such as mystery shopping, may give more stimuli to change. Therefore, this research argues that mystery shopping can be a useful instrument in addition to the more often-used survey methods.

management
Comparing Mystery Shopping with Smartphone and Traditional Mystery Shopping

Catherine Gabrielle Santoso,Pei-Luen Patrick Rau,Yubo Zhang

DOI: https://doi.org/10.54941/ahfe100560

2021-01-01

Abstract:This study aims to investigate different methodologies in performing mystery shopping programs, i.e. new (call, SMS, and notes) and traditional methodologies in the aspect of shoppers’ workload, satisfaction, consistency, accuracy and timing. For that purpose, a single factor experiment with four levels was designed in this research. A smartphone and computer-mediated experiment was conducted with 40 Chinese students. The results showed that the traditional method was the most consistent method and there was no significant difference among the other three mystery shopping methods. However, the results also demonstrated that traditional method was the least accurate and there was no significant difference among the other three methods. The researcher also found that when conducting a mystery shopping program, the SMS method took the longest time, followed by the calling method. Finally, this research discusses the implications of these findings for developing mystery shopping guidelines.
'Mystery shoppers' can uncover ED weaknesses

Abstract:One veteran "mystery shopper" has uncovered several common ED practices that can hurt patient satisfaction. You can learn from her observations to improve your ED's customer service: Be sure to let all of your patients know how long they might expect to wait before seeing a doctor. Wash your hands where the patient can see you, so they can be confident you are practicing good hygiene. Clearly explain all forms and discharge instructions to help ensure patient compliance.
Social Media Marketing and Ghost Shopping Approach; a New Business Tool

Preethi Sarah Jp,Anand Shankar Raja Manivannan

2018-01-02

Abstract:Research motivation: The researcher is a mystery shopper who has vast experience in various field analyses. The researcher has taken up a few good assignments in various domains, which has given him a good experience. Thus, this experience has motivated the researcher to explore how mystery shopping is used in social media and how the process works in reality. The connectivity between mystery shopping and social media is a new emerging topic and only a very few research work is seen and hence this gap has been used to proceed with this research title. Research materials and methods: The research work makes use of quantitative and qualitative techniques to draw and analyze the data. The respondents for this research work is mystery shoppers, market research agencies, experts in marketing research and mystery shopping, a few marketers who deal with digital marketing etc. The tool used for this research is factor analysis for quantitative analysis and various qualitative techniques to determine the experience, observations, past case studies and literature works.<br><br>Research outcome: From the quantitative techniques, it is clear that customer experience and relationship between the sales representatives and the customers dealing through online marketing plays an important role in the success of social media marketing which the mystery shoppers observe. Based on the observations a detailed report is submitted which will enhance the firms to form strong strategies. Future scope: The future researchers can analyze on the related aspects of mystery shopping and social media. The problems faced by mystery shoppers with regard to social media observations, the skills needed to deal with digital tools can be researched.

Business
Report of a user-satisfaction analysis of a service provider for an oncology clinic

Michael Hartmann,Holger Knoth,Daniel Kühne,Daniel K�hne

DOI: https://doi.org/10.1007/s00432-003-0513-z

2004-02-01

Journal of Cancer Research and Clinical Oncology

Abstract:Purpose We used a questionnaire to assess professional user-satisfaction concerning the quality of services provided by a university hospital pharmacy for an oncology clinic.Methods All staff members at a major university medical center were given questionnaires pertaining to their satisfaction with various aspects of the services of the center’s pharmacy department. The data analysis was carried out differentiating between the occupational groups and the various service sectors.Results Responding subjects (n=460, 15% yield) were generally satisfied with the quality of all sections of the hospital pharmacy. Features appreciated included competence, reliability, flexibility, and rapid service, as well as helpfulness and friendliness. However, assessments differed among occupational groups: those working in the natural sciences tended to be most critical of pharmacy services, including availability of up-to-date information and speed of service.Conclusions By surveying user-satisfaction, several shortcomings in the pharmacy ordering and complaint-management system were detected. Study findings should lead to improved service quality and will contribute to developing a manual for a quality management system (QMS).

oncology
The effect of a mystery shopper scheme on prescribing behavior in primary care: Results from a field experiment

Roland Cheo,Ge Ge,Geir Godager,Rugang Liu,Jian Wang,Qiqi Wang

DOI: https://doi.org/10.1186/s13561-020-00290-z

2020-09-24

Health Economics Review

Abstract:Abstract Background Health care systems in many countries are characterized by limited availability of provider performance data that can be used to design and implement welfare improving reforms in the health sector. We question whether a simple mystery shopper scheme can be an effective measure to improve primary care quality in such settings. Methods Using a randomized treatment-control design, we conducted a field experiment in primary care clinics in a Chinese city. We investigate whether informing physicians of a forthcoming mystery shopper audit influences their prescribing behavior. The intervention effects are estimated using conditional fixed-effects logistic regression. The estimated coefficients are interpreted as marginal utilities in a choice model. Results Our findings suggest that the mystery shopper intervention reduced the probability of prescribing overall. Moreover, the intervention had heterogeneous effects on different types of drugs. Conclusions This study provides new evidence suggesting that announced performance auditing of primary care providers could directly affect physician behavior even when it is not combined with pay-for-performance, or measures such as reminders, feedback or educational interventions.

economics,health policy & services
Mystery Shopper Programs in the Tourism Sector

Eda Özgül Katlav,Şule Aydin

DOI: https://doi.org/10.4018/978-1-7998-2204-2.ch006

2020-01-01

Abstract:In today's world, there is fierce competition in the tourism sector, and therefore, the businesses need to improve their service qualities constantly and enhance their service processes to meet customer expectations swiftly and effectively. In recent years, tourism operators have been focusing on customer-oriented research and programs to avoid negative results that may be caused by unsatisfied customers. The service quality of tourism businesses is directly based on the performance of the employees; therefore, it is very important to evaluate the performances of the employees and improve service processes to avoid potential problems. Mystery shopper programs show the true picture of the services offered to the guests by the tourism businesses. Therefore, mystery shopper programs are widely used in the world for the evaluation of employees, especially in service-provider companies. The mystery shopper programs provide information on service quality, employee performance, and customer satisfaction, which is used by the businesses to improve or develop their service delivery processes.
Mystery Shopper Study of State Medicaid Coverage for Out-of-State Abortion Care

Hazar Khidir,Carlisle Topping,Vanessa K. Dalton,Stacy Tessler Lindau,Arjun K. Venkatesh

DOI: https://doi.org/10.1001/jamanetworkopen.2023.43569

2023-11-15

JAMA Network Open

Abstract:This cross-sectional study uses a mystery shopper survey to examine variation in state Medicaid agency responses to coverage questions on out-of-state abortion care.

medicine, general & internal
A comparative study of customer service level based on service marketing mix (7Ps) in selected public and private sector banks in Bhopal, MP, India, by using mystery shopping as a tool

Satyendra Kumar,Trupti Samir Almoula

DOI: https://doi.org/10.1504/ijfsm.2020.111106

2020-01-01

International Journal of Financial Services Management

Abstract:Bank marketing revolves around the service marketing mix (7Ps) i.e., Product, Price, Place, Promotion, People, Process and Physical Evidence, to satisfy customers requirements. It has been observed that these 7Ps vary significantly within the public and private sector banks. The objective of this study is to compare these 7Ps in the selected public and private sector banks in Bhopal, MP, India, by using mystery shopping behaviour as a tool to collect customers' perception of the service level of banks. It focuses on observations made by mystery shoppers for comparing service levels at different banks during the branch visit made by them. This paper will help the bankers to acknowledge the comparative, rather competitive strengths they have and the areas of improvement which they must work on and also help them to formulate action plans to retain existing customers and attract new customers by taking care of 7Ps.
Practice makes perfect: an Rx for healthy customer service

Jodi Manfredi

Abstract:Evaluating the health of your practice is about much more than clinical skills or Occupational Safety and Health Administration regulations. It's about how your patients feel emotionally when they leave your office. When they've been treated with professionalism, kindness, and respect, they'll not only return--they'll refer. Happy patients are the key to a successful practice, especially for fee-for-service practices that rely heavily on referrals. In this article, the concept of the use of "mystery shoppers" in the medical practice, which has recently been featured on ABC News and in the Wall Street Journal, is discussed.
Critical Service Encounters: The Employee's Viewpoint

Mary Jo Bitner,Bernard H. Booms,Lois A. Mohr

DOI: https://doi.org/10.1177/002224299405800408

IF: 15.36

1994-10-01

Journal of Marketing

Abstract:In service settings, customer satisfaction is often influenced by the quality of the interpersonal interaction between the customer and the contact employee. Previous research has identified the sources of satisfaction and dissatisfaction in service encounters from the customer's point of view; this study explores these sources in service encounters from the contact employee's point of view. Drawing on insights from role, script, and attribution theories, 774 critical service encounters reported by employees of the hotel, restaurant, and airline industries are analyzed and compared with previous research. Results generally support the theoretical predictions and also identify an additional source of customer dissatisfaction—the customer's own misbehavior. The findings have implications for business practice in managing service encounters, employee empowerment and training, and managing customers.

business
A Note on the Level of Customer Support by State Governments: A Mystery-Shopping Approach

Oeindrila Dube,Devin G. Pope,Sendhil Mullainathan

DOI: https://doi.org/10.2139/ssrn.3894702

2021-01-01

SSRN Electronic Journal

Abstract:Many government services are provided at the state level such as unemployment insurance, Medicaid, and SNAP. Given the lack of competition, a natural worry is that customer support provided by states for these services is less than adequate. While there are many different measures of how a state can support beneficiaries, we focus on just one in this short and applied report: the ability to get a live representative on the phone to help with an application question. To do this, we take a “mystery shopping” approach and make 2,000 phone calls to state government offices. We find substantial heterogeneity in the availability of live phone representatives across states and types of service (UI, Medicaid, etc.). For example, live representatives in New Jersey and Georgia were reached less than 20% of the time while representatives in New Hampshire and Wisconsin were reached more than 80% of the time. We hope that this report provides a simple example for how academics, investigative reporters, and watch groups can help states be more accountable for their customer support systems.
A systematic review of the use of simulated patient methodology in pharmacy practice research from 2006 to 2016

Ingunn Björnsdottir,Anne Gerd Granas,Amanda Bradley,Pauline Norris

DOI: https://doi.org/10.1111/ijpp.12570

2019-08-09

International Journal of Pharmacy Practice

Abstract:Abstract Objectives Simulated patient (SP) methodology (mystery shopping) is used increasingly to assess quality of pharmacy services, and evaluate impact of interventions. Our objective was to review papers reporting on the use of SP methodology in pharmacy practice research 2006–2016 in community pharmacies worldwide. Methods We searched EMBASE and MEDLINE for papers reporting on the use of mystery shopping in pharmacy settings, using a wide range of terms for SPs, based on previous review. We removed irrelevant papers, duplicates, papers not written in English, and review papers and reviewed remaining papers. Two reviewers carried out data abstraction, using the same tool as the previous review and inserting data into Excel, focusing on how the SP methodology is used. Key findings A total of 148 papers from 52 countries from all regions of the world were included in the review. A wide range of terms described the method, and simulated patient was the most common (49 papers). Most studies were cross-sectional (124), and most investigated only community pharmacies (115). The most common aim was to evaluate some aspect of pharmacists’ or other staff's advice and counselling (94). Number of visits is 2-7785. Many papers did not cover details, such as number of visits planned, and carried out, scenario used, training and background of SPs, and ethical approval for the study. Conclusions The use of SP methodology has increased substantially in the field of pharmacy over the past decade. This is a useful method in a wide range of countries and settings. Greater detail is required in reporting.

English Else
A Gap Analysis of Professional Service Quality

Stephen W. Brown,Teresa A. Swartz

DOI: https://doi.org/10.1177/002224298905300207

IF: 15.36

1989-04-01

Journal of Marketing

Abstract:Providers of professional services recently have awakened to consumer challenges, competition, and the realities of marketing. With these changes, a related and equally important issue has emerged—service quality and evaluating the service encounter. Using medical services as the primary study setting, the authors explore the concept of professional services quality and its evaluation from both the provider and client perspectives. They use gap analysis as an appropriate approach for examining the evaluation of a professional service. The findings provide special empirical insights on the gaps that can arise from inconsistent perceptions of expectations and experiences between patients and physicians. Finally, both managerial and research implications are presented.

business
[User Satisfaction in Social Media: How do Patients Rate their Hospital Stay Online?]

Felix Hopf,Christiane Patzelt,Anja Schindler,Martin Emmert,Uwe Sander

DOI: https://doi.org/10.1055/a-1399-9508

Abstract:Background: Patients are increasingly using social media and review sites to get information on hospitals, to rate them or to write a review about their own experiences during hospital stay. Hospitals have the opportunity to use these patient reviews for internal quality assurance as well as online reputation marketing. Objective: The objective is to analyze the satisfaction ratings of previous hospitals stays by social media users on platforms such as "Google", as well as reviews from the German site "Klinikbewertungen.de", and to compare them. Methods: User reviews (n=16,691) for all hospitals (n=180) in the federal state of Lower Saxony (complete survey) for 2013-2018 were extracted from the platforms Google and the German Klinikbewertungen.de. Subsequently, a descriptive and inductive analysis (Chi²-test) of the user reviews and a comparison specific for the platforms were completed. Results: Most users are satisfied with their hospital stay, whereby users of the platform Google ratd their hospital stay worse (n=6,181; 57.6% satisfied) than users of the platform Klinikbewertungen.de (n=10,509; 65.4% satisfied). Features of the hospital (number of beds, specialist departments) and features of the users (author, type of insurance) were significantly associated with the rating for the hospital stay (star review). (Google: number of beds p<0.001; Klinikbewertungen.de: number of beds p<0.001, author p<0.001, specialist departments p<0.001, type of insurance p<0.001). Conclusion: The online review of a hospital stay is associated with the number of beds, the specialist departments of hospitals, whether the author is the patient or a relative, and the type of health insurance they have, namely private or statutory. Online reviews and ratings for hospitals may be used for internal quality assurance or improvements of company online reputation.
Health Care Delivery Meets Hospitality: A Pilot Study in Radiology

Joseph Rodgers Steele,A Kyle Jones,Ryan K Clarke,Stowe Shoemaker

DOI: https://doi.org/10.1016/j.jacr.2014.10.008

Abstract:The patient experience has moved to the forefront of health care-delivery research. The University of Texas MD Anderson Cancer Center Department of Diagnostic Radiology began collaborating in 2011 with the University of Houston Conrad N. Hilton College of Hotel and Restaurant Management, and in 2013 with the University of Nevada, Las Vegas, William F. Harrah College of Hotel Administration, to explore the application of service science to improving the patient experience. A collaborative pilot study was undertaken by these 3 institutions to identify and rank the specific needs and expectations of patients undergoing imaging procedures in the MD Anderson Department of Diagnostic Radiology. We first conducted interviews with patients, providers, and staff to identify factors perceived to affect the patient experience. Next, to confirm these factors and determine their relative importance, we surveyed more than 6,000 patients by e-mail. All factors considered important in the interviews were confirmed as important in the surveys. The surveys showed that the most important factors were acknowledgment of the patient's concerns, being treated with respect, and being treated like a person, not a "number"; these factors were more important than privacy, short waiting times, being able to meet with a radiologist, and being approached by a staff member versus having one's name called out in the waiting room. Our work shows that it is possible to identify and rank factors affecting patient satisfaction using techniques employed by the hospitality industry. Such factors can be used to measure and improve the patient experience.

The mystery shopper: an anonymous review of your services

The mystery shopper: a tool to measure public service delivery?

Shopping bad service

Mystery shopping as a quality adjunct in public health organizations

Mystery patient insight into clinical laboratory service

Mystery shopping: A tool to develop insight into customer service provision

Comparing Mystery Shopping with Smartphone and Traditional Mystery Shopping

'Mystery shoppers' can uncover ED weaknesses

Social Media Marketing and Ghost Shopping Approach; a New Business Tool

Report of a user-satisfaction analysis of a service provider for an oncology clinic

The effect of a mystery shopper scheme on prescribing behavior in primary care: Results from a field experiment

Mystery Shopper Programs in the Tourism Sector

Mystery Shopper Study of State Medicaid Coverage for Out-of-State Abortion Care

A comparative study of customer service level based on service marketing mix (7Ps) in selected public and private sector banks in Bhopal, MP, India, by using mystery shopping as a tool

Practice makes perfect: an Rx for healthy customer service

Critical Service Encounters: The Employee's Viewpoint

A Note on the Level of Customer Support by State Governments: A Mystery-Shopping Approach

A systematic review of the use of simulated patient methodology in pharmacy practice research from 2006 to 2016

A Gap Analysis of Professional Service Quality

[User Satisfaction in Social Media: How do Patients Rate their Hospital Stay Online?]

Health Care Delivery Meets Hospitality: A Pilot Study in Radiology