AmirMohammad Dadkhah
You can request a meeting with AmirMohammad on Ropera.
Set a MeetingA Data Engineer who loves building & maintaining scalable Data Pipelines for Big Data, Data Warehousing & Analytics platforms.
Areas of Expertise
Data Science and Analytics
Work with data scientists to come up with key inputs to various models and decision-making projects and products such as anomalies and fraud detection
Software Development
Build, maintain and scale AloPeyk's data platform and infrastructure which performs: - Real-Time streaming of MySQL and MongoDB tables/collections into Avro-serialized Kafka topics by reading BinLogs/OpLogs of databases - Using Spark scheduled batch jobs to Convert Avro files of data to columnar storage format (Parquet) and store Parquet files in HDFS - Real-time storing of most-used data into MemSQL database for faster data delivery to the business dashboards and ETL - Hosting/Serving Apache Superset as data exploration/visualization platform for designed business dashboards and automated reports to support high-level decision making. - Hosting/Serving Presto as high performance distributed SQL query engine which allows users to query MongoDB, MySQL, Hive and MemSQL - Maintain Apache Airflow as workflow management platform which used to author, schedule & monitor workflows - Write/Edit directed acyclic graphs (DAGs) in Python for Apache Airflow to manage workflow orchestration