11/18/2025 updated


40 % partially available
Data Engineer
zipaquirá, Colombia
Only remote
Master BI and DatascienceAbout me
Systems Engineer, with more than 7 years of Experience, strong abilities for data structures, create ETLs, Dashboards to evaluate KPIs, goal oriented, responsible. Person that is interested to know more about innovation and technology such as cloud, current trends and always gain new knowledge.
Amazon Web ServicesDatabasesCronInformation EngineeringExtract Transform Load (ETL)Data MartLinuxApache HadoopHadoop Distributed File SystemMicrosoft SQL ServersOracle ApplicationsPentaho Data IntegrationMicrosoft Power BIScalaStored Procedure
ETL, Scala, Spark, HDFS, hadoop, DWH, crontab Linux, Datamart, AWS, GCP, databases, Stored Procedures, SSIS ETL, SSIS, Pentaho, Power Bi, SQL server, Oracle, SSIS ETLs, Scala
Experience
Professional experience5 - 10 years
Freelancer since2022
Languages
EnglishGood
Project history
• Process Automation: Reduced the time of manual
executions by 50% in 7 months by automating a crucial
part of the process, resulting in significant efficiency
gains and allowing the team to focus on higher-value
tasks.
• API Development: Developed APIs to improve and
automate processes on GCP platform, leading to faster
and more reliable data exchange between systems and
enhancing overall system performance.
• Data Pipeline Optimization: Utilized AWS Glue for data
pipelines, streamlining data processing and
integration, which improved data accuracy and
reduced processing times.
• Technical Proficiency: Proficient in SQL and Python,
consistently delivering high-quality code and solutions
to complex data challenges.
• Agile Methodologies: Experienced in Agile
methodologies using Jira platform, ensuring efficient
project management, timely delivery, and continuous
improvement through iterative development.
• Advanced Toolset: Skilled in Docker, BigQuery, Glue,
and Athena, leveraging these tools to build scalable
and robust data solutions that meet business
requirements.
• Production Issue Resolution: Rapid identification and
resolution of problems affecting live environments.
• Timeline-Based Management: Prioritizing and
addressing issues according to urgency and impact,
ensuring timely interventions.
Cost Optimization: Reduced budget spending by 50%
by changing code and architecture, resulting in
substantial savings and improved resource allocation
for other critical projects.• Data Pipeline Creation: Created pipelines with Data
Factory to process data and upload files from file
servers, SQL Server on-premises, and Azure
Containers, enhancing data integration and processing
efficiency.
• Data Architecture Design: Defined and structured data
architecture, ensuring a scalable and efficient
framework for data management and analytics.
• Advanced Data Processing: Developed data processing
on Databricks using Python and SQL, effectively
managing the scope for secrets and enhancing data
security and processing speed.
• Power BI Proficiency: Proficient in DAX for Power BI,
enabling the creation of sophisticated data
visualizations and insightful dashboards.
• Scrum Coordination: Coordinated developments with
Scrum, ensuring efficient team collaboration and timely
delivery of project milestones.
• Agile Methodologies and DevOps: Utilized Agile
methodologies with DevOps, registering and following
up with Azure DevOps to streamline development
processes and enhance project visibility.
• Project Management Skills: Skilled in Project
Management, overseeing project lifecycle from
planning to execution, and ensuring alignment with
business objectives.
• Managing production Deployment: Manage production
deployments and solving problems during
implementation and daily work.
• Led a Team to Success: Managed a cross-functional
team that developed and deployed a real-time API to
generate scores within just 4 months, significantly
improving our data analysis capabilities and response
time.
• Optimized Data Pipelines: Created and optimized ETLs
using PySpark and Python, resulting in a 30% increase
in data processing efficiency and reducing latency in
data delivery.
• Enhanced Data Storage: Utilized AWS S3 to create
robust information repositories and implemented
Lambda functions to ensure seamless and timely
updates, enhancing data accessibility and reliability.
• Streamlined Data Transfers: Designed and
implemented data transfer solutions using GCP,
BigQuery tables, cloud storage, and Cloud Functions,
facilitating smooth and secure data migration across
platforms.
• Advanced Data Querying: Leveraged Snowflake for
advanced querying, leading to a 20% improvement in
data retrieval times and more accurate insights.
• Dashboard Creation: Utilized Data Studio to design and
create interactive dashboards for KPIs and data
analytics, empowering stakeholders with real-time
insights and decision-making capabilities.• Mastered Tabular Models: Demonstrated expertise in
creating and managing tabular models, ensuring
efficient data organization and retrieval.
• Technical Proficiency: Proficient in SQL, Python, and
PySpark, consistently delivering high-quality code and
solutions.
• Architected Data Solutions: Designed comprehensive
data architecture to create scalable pipelines and
managed teams to customize and enhance existing
dashboards, leading to improved data visualization and
user experience.
• Infrastructure Development: Developed infrastructure
using Terraform to automate the creation of cloud
functions, BigQuery tables, and data transfers,
ensuring a reliable and scalable environment.
• API Development with Docker: Created and deployed
Docker images for APIs, streamlining the development
and deployment process, and enhancing application
performance.
• Project Management Expertise: Successfully managed
multiple projects, ensuring timely delivery, adherence
to budget constraints, and alignment with business
objectives.