Build, maintain and scale AloPeyk's data platform and infrastructure which performs: - Real-Time streaming of MySQL and MongoDB tables/collections into Avro-serialized Kafka topics by reading BinLogs/OpLogs of databases - Using Spark scheduled batch jobs to Convert Avro files of data to columnar storage format (Parquet) and store Parquet files in HDFS - Real-time storing of most-used data into MemSQL database for faster data delivery to the business dashboards and ETL - Hosting/Serving Apache Superset as data exploration/visualization platform for designed business dashboards and automated reports to support high-level decision making. - Hosting/Serving Presto as high performance distributed SQL query engine which allows users to query MongoDB, MySQL, Hive and MemSQL - Maintain Apache Airflow as workflow management platform which used to author, schedule & monitor workflows - Write/Edit directed acyclic graphs (DAGs) in Python for Apache Airflow to manage workflow orchestration

Work with data scientists to come up with key inputs to various models and decision-making projects and products such as anomalies and fraud detection