As a Data Engineering Intern at the Hong Kong Standards and Testing Centre (STC), I co-led the development of a custom data aggregation platform to centralize and visualize web analytics from platforms like Google Analytics, Meta (Facebook/Instagram), LinkedIn, YouTube, and more. This solution enabled STC to make real-time, data-driven marketing decisions, while reducing reporting overhead and increasing campaign efficiency.

After conducting interviews with STC’s marketing team, we identified a critical gap in their ability to synthesize performance data across disparate tools. Off-the-shelf platforms such as Coupler.io and Funnel.io lacked full support for STC’s international stack and were cost-prohibitive. Based on a stakeholder-weighted decision matrix, we proposed and implemented a fully custom-built aggregator.

Our platform included:
• API integrations to fetch and sync live data from each service
• A dual-layered storage system (cache + persistent database) for efficient retrieval and historical access
• A dashboard interface with interactive visualizations (color-coded charts, time range filters)
• User authentication (Admin/Default roles)
• An automated report generator exporting clean, Excel-formatted marketing summaries

We used tools like Python, JavaScript, Google Apps Script, and Firebase to build backend infrastructure and interface with APIs, including secure token refresh handling. One major innovation was a fallback system where data is retrieved from cache, database, or live API based on availability — optimizing for speed, cost, and accuracy.

Throughout development, we followed an agile methodology with weekly user acceptance testing (UAT) and real-time feedback from STC’s team. Based on this feedback, we implemented new features like a year-over-year performance comparison tab, as well as a more intuitive error-handling system.

Our final deliverables included:
• A working custom dashboard platform
• An implementation and user guide
• A technical documentation package

This project highlighted my ability to bridge engineering and business goals in an international setting, and sharpened my skills in data pipeline design, API integration, full-stack development, and marketing analytics strategy.