David Lukić

Transforming Data into Insights

Data Engineer | Python Developer | AWS Cloud Specialist | Big Data Expert

5+
Years Experience
1M+
Records Processed Daily
100%
Job Success Score

Specialized in designing and implementing scalable data pipelines, ETL processes, and cloud-based data solutions

Download CV View Projects Hire Me on Upwork

About Me

Data Engineer & Python Developer

With 5 years of experience in the data engineering field, I specialize in designing and implementing scalable data solutions that transform raw information into actionable insights. My expertise spans across the entire data lifecycle - from ingestion and processing to storage and visualization.

I'm passionate about building efficient data pipelines, optimizing database performance, and creating automated workflows that save time and resources. My approach combines technical expertise with business understanding to deliver solutions that drive real value.

Currently working as a Data Engineer at index.dev and BetterCollective, where I help transform complex data challenges into elegant, scalable solutions.

Key Achievements

Application Development

Developed 7 applications within in-house Django-based solution, reducing manual intervention by 80% and improving team productivity

Performance Optimization

Designed LogAna, an automated log file analysis tool, reducing processing time by 400% and enhancing data accuracy by 40%

Data Pipeline Engineering

Engineered robust data pipelines processing millions of records daily with 99.9% uptime and sub-minute latency

Cloud Infrastructure

Implemented AWS-based data lake architecture, reducing storage costs by 35% while improving data accessibility

Technical Skills

Data Engineering

  • ETL/ELT Pipeline Development
  • Data Modeling
  • SQL & Database Optimization
  • Data Warehousing
  • Data Quality Management
  • Database Design

Big Data

  • Apache Airflow
  • Dagster
  • Spark
  • Kafka
  • Data Lakes
  • Batch & Stream Processing

Cloud & DevOps

  • AWS (S3, Lambda, Glue, Redshift)
  • Docker & Containerization
  • CI/CD Pipelines
  • Infrastructure as Code
  • Linux Administration
  • Bash Scripting

Programming & Web

  • Python
  • Django & Flask
  • API Development
  • JavaScript
  • Automation
  • Web Scraping

Data Engineering Projects

Data Pipeline Project

Enterprise Data Pipeline

Python AWS Glue S3 Airflow

Designed and implemented scalable ETL processes handling 1M+ daily records with AWS Glue and S3, achieving sub-minute latency and 99.9% reliability.

View Details
Database UI Project

Data Management Platform

MySQL Django Python Redis

Built a comprehensive data management platform with automated ingestion pipelines, custom schema design, and intuitive visualization interface.

View Details
AWS Architecture

Cloud Data Infrastructure

AWS Terraform Docker Kubernetes

Architected and deployed a scalable, fault-tolerant data lake and warehouse solution on AWS, reducing storage costs by 35% while improving data accessibility.

View Details
Log Analysis Tool

LogAna - Log Analysis System

Python Django PostgreSQL Celery

Developed an automated log file analysis tool that reduced processing time by 400% and enhanced data accuracy by 40%, with real-time alerting capabilities.

View Details
Data Visualization Dashboard

Interactive Analytics Dashboard

Python Plotly Django JavaScript

Created interactive data visualization dashboards that transformed complex datasets into actionable business insights, increasing decision-making efficiency by 60%.

View Details
Web Scraping System

Distributed Data Collection System

Python Redis PostgreSQL Asyncio

Engineered a high-performance, distributed web scraping system with intelligent rate limiting, proxy rotation, and fault tolerance, processing 10M+ data points daily.

View Details

Client Testimonials

"David is a highly skilled data engineer who consistently delivers high-quality work. His attention to detail and problem-solving abilities are exceptional. He transformed our messy data infrastructure into a streamlined, efficient system."
"Working with David was a pleasure. He understood our complex data requirements quickly and delivered a solution that exceeded our expectations. His expertise in AWS and data pipeline development saved us months of work."
"David's expertise in data engineering helped us streamline our processes and improve efficiency by over 200%. His solutions are not just technically sound but also aligned with business objectives. Highly recommended for any data engineering project!"
100% Job Success Score on Upwork

Let's Work Together

Looking for a data engineer to help transform your data challenges into opportunities? I'm currently available for freelance projects and consulting.