The role of Nukomeet was to automate and optimize ETL (extract, transform, load) flow. Vast amount of data gathered by electronic cigarettes needed to be quickly processed in order to provide near real-time statistics.
Data extraction involved integrating various heterogeneous sources; data transformation processes data by transforming them into a proper storage format/structure for the purposes of querying and analysis; finally, data loading describes the insertion of data into the final target database.
For this project we opted for a micro service architecture, i.e. we built several independent and loosely coupled services, each with a specific goal (using Amazon Web Services).