Decipher Standalone vs Decipher + SurveyTester

Laura-Blacklock Oct 10, 2024 FAQ
Facebook Twitter Google + LinkedIn Pinterest Email Share...

Introduction

This comparison provides a detailed analysis of Decipher's standalone functionality versus Decipher integrated with SurveyTester. The focus is on two critical areas: Dummy Data Creation and Issue Reporting & Handling. The table highlights key differences in features and capabilities between these two approaches, offering an objective look at how the tools can support survey quality assurance and data management processes.

Dummy Data Creation

Feature Decipher Standalone Decipher + SurveyTester
1. Create random data ✅ ✅
2. Simulate Respondent (e.g., Drag & Drop Questions)   ✅
3. Use Test Cases   ✅
4. Answer Constant Sum questions   ✅
5. Define Test Strategy (e.g., Must Answer Check, etc.)   ✅

 

Issue Reporting & Handling

Feature Decipher Standalone Decipher + SurveyTester
6. See other tester’s reported issues and status ? ✅
7. Add Feedback directly on the interview screen ✅ ✅
8. Include Non-Decipher users to report issues ✅ ✅
9. Define and use custom classification fields   ✅
10. Full issue collaboration features   ✅
11. Edit Labels directly on screen   ✅
12. Create screenshots for issues   ✅
13. Track and view tester’s route to a reported issue
✳️
 ✅
14. Create new test run with tester’s answers   ✅
15. Automatically detect technical issues   ✅

Details for Dummy Data Creation

  1. Create Random Data

    Both Decipher and SurveyTester can generate dummy data. Decipher achieves this through an efficient internal mechanism that writes directly to the database. In contrast, SurveyTester generates data through its browser interface, which takes longer due to its reliance on actual survey interactions.

  2. Simulate Respondent

    SurveyTester goes beyond random data generation by simulating respondent behavior within the survey interface. This means that dynamic elements such as disabled fields or custom JavaScript behavior are respected, helping to uncover issues that might be missed by Decipher’s internal dummy data generation.

  3. Use Test Cases

    SurveyTester allows precise control over test scenarios, ensuring that questions requiring specific inputs (e.g., UK postal codes or membership IDs) are handled appropriately. Decipher’s random data generator may result in multiple screenouts, making targeted testing more difficult.

  4. Answer Constant Sum Questions

    SurveyTester automatically recognizes and answers constant sum questions by analyzing the required sums in real-time, improving testing accuracy compared to Decipher’s capabilities.

  5. Define Test Strategy

    SurveyTester enables the creation of customized test strategies, including validation checks for mandatory questions, randomized categories, and numeric input constraints. These automated checks occur in the background during the data generation process.

Details for Issue Reporting & Handling

  1. See Other Testers' Reported Issues

    SurveyTester offers full visibility into reported issues, preventing redundant reports by displaying all found issues, screenshots, and status information for the current page. This feature is not available in Decipher.

  2. Add Feedback Directly on the Interview Screen

    While both Decipher and SurveyTester allow testers to provide feedback during testing, SurveyTester enhances this functionality with structured issue classification, visual annotations, and automatic screenshot generation.

  3. Include Non-Decipher Users to Report Issues

    Both systems support issue reporting by external users without login credentials, but SurveyTester provides more controlled access, allowing limited external user roles within the workflow.

  4. Define and Use Custom Classification Fields

    SurveyTester allows organizations to customize classification fields for issues, enabling more detailed reporting and post-test analysis, a feature not present in Decipher.

  5. Full Issue Collaboration Features

    SurveyTester provides a comprehensive issue management workflow, facilitating collaboration between testers, survey authors, and project managers, ensuring transparency and progress tracking for all reported issues.

  6. Edit Labels Directly on Screen

    SurveyTester supports in-situ label editing, simplifying the revision process for project managers and linguists by allowing direct changes on the survey interface.

  7. Create Screenshots for Issues

    SurveyTester automatically generates and stores screenshots for each reported issue, streamlining the documentation process, while Decipher does not offer integrated screenshot functionality.

  8. Track and View Tester’s Route to a Reported Issue

    SurveyTester tracks each tester's path through the survey, including changes made via back navigation. This detailed tracking can reveal issues caused by certain navigation patterns, which may go unnoticed in Decipher.

  9. Create New Test Run with Tester’s Answers

    SurveyTester stores all input data from test runs, allowing testers to quickly replay a test with updated survey logic. This feature is not available in Decipher, where users rely on manual navigation to retest issues.

  10. Automatically Detect Technical Issues

    SurveyTester proactively identifies technical issues, such as broken links or incorrect file formats, which are not detected by Decipher’s internal testing tools.

Conclusion

This comparison illustrates that while Decipher’s standalone functionality offers basic dummy data creation and issue reporting tools, integrating SurveyTester brings advanced testing and collaboration capabilities. SurveyTester’s focus on real-world testing scenarios, comprehensive issue tracking, and team collaboration makes it a powerful addition to Decipher, especially for teams handling complex surveys or working in collaborative environments.

For more information, visit  www.SurveyTester.com  or contact us at info@surveytester.com.

Add comment