A key client and business stream for KS&R wanted to be able to gain deeper insights through more tailored reporting of their survey data. With survey data from hundreds of respondents in recurring waves, generating individual PDF reports for survey respondents to be submitted to their client weekly required completely rebuilding and automating KS&R’s reporting pipeline.
Like many established research firms, KS&R’s infrastructure was built on years of proven processes that were ready to be modernized, which created initial challenges for delivering the requested reports. The team recognized it was time to “turn the ship” toward a more modernized, sustainable approach.
Legacy Process:
- Multiple specialized pipelines: Survey data moved through SPSS, Excel, and manual wrangling before reaching reporting teams. This created bottlenecks, as pipeline knowledge resided with individuals and was lost when team members departed.
- Outdated reporting workflows: Client-ready PDFs were generated with legacy tools, which limited flexibility and version control. Changes were time-consuming, and scaling reports for hundreds of respondents across multiple survey waves proved difficult.
- Limited reproducibility and collaboration: The lack of GitHub-based version control and standardized environments led to inconsistent code management, process documentation, and project collaboration, hindering reproducibility.
- Growing need to accelerate time-to-insight: Clients required timely results for critical business decisions, but the process from raw survey data to actionable insights was often too slow.