Carlos andr<s:1> Castaño Varela,开发商在巴兰基利亚-大西洋,哥伦比亚
Carlos is available for hire
Hire Carlos

Carlos Andrés Castaño Varela

Verified Expert  in Engineering

Data Developer

Location
Barranquilla - Atlantico, Colombia
Toptal Member Since
October 7, 2022

卡洛斯是一位经验丰富的数据工程师,他利用了他以前的制造业经验, eCommerce, 和创业知识,有效地为客户提供有意义和高质量的解决方案. 卡洛斯对数据有很大的热情,渴望解决新的挑战,并随时提供帮助.

Portfolio

Molyworks Materials Corp
Microsoft Power BI, Microsoft SQL Server, Azure, Azure SQL Databases...
EPAM Systems
ETL工具,Tableau, Python,数据质量,数据管道,ETL,仪表板...
Water UX, Inc
数据工程,Apache气流,亚马逊雅典娜,红移,数据管道,ETL...

Experience

Availability

Part-time

Preferred Environment

Windows Subsystem for Linux (WSL), Ubuntu, MacOS, Amazon EC2, Apache Airflow, Amazon RDS, Amazon QuickSight, Tableau, Visual Studio Code (VS Code), Git

The most amazing...

...我开发的是一个完整的端到端数据解决方案,为客户带来可见性和新的商业理念.

Work Experience

Power BI Developer

2022 - PRESENT
Molyworks Materials Corp
  • 使用Azure SQL数据库(基于MS SQL Server)设计并实现了一个数据仓库.
  • 在Azure Data Factory中构建了10多个管道,作为一个ETL进程,从不同的数据源(如Excel文件)提取数据, MS SQL Databases (on-prem), and Gsheets.
  • 根据存储在DWH中的数据创建了10多个MS Power BI报告,这些报告提供了对流程的见解.
Technologies: Microsoft Power BI, Microsoft SQL Server, Azure, Azure SQL Databases, Azure Data Factory, Azure Blobs, DAX, SharePoint

Senior Software Engineer

2022 - PRESENT
EPAM Systems
  • 在客户的ETL工具中开发了几个管道,为进一步的数据分析提供信息,并迅速获得了客户基础设施的专业知识.
  • 基于之前的流水线工作,创建并更新了几个Tableau仪表板.
  • 设计复杂的SQL查询,从多个数据源中提取信息,为报告做准备.
Technologies: ETL工具,Tableau, Python,数据质量,数据管道,ETL,仪表板, Business Intelligence (BI), Data Management, SQL, Windows, Visual Studio Code (VS Code), Data Analytics, Data Analysis, Analytics, Data Visualization, Databases, BI Reporting, Data Warehousing

Data Engineer

2022 - 2023
Water UX, Inc
  • 使用规范化技术和Apache Airflow开发了一个ETL流程,用于将数据从PostgreSQL实例提取到另一个实例.
  • 设计并实现了一个PostgreSQL数据库模式,用于存储web应用程序中使用的规范化数据.
  • 使用Python和Pandas创建基于用水量数据的分析报告.
Technologies: 数据工程,Apache气流,亚马逊雅典娜,红移,数据管道,ETL, PostgreSQL, Amazon RDS, Pandas

Data Analyst | Engineer

2021 - 2022
LaHaus
  • Delivered an end-to-end data extraction, conversion, data quality, loading, and analytics solution to bring visibility to an entire company area.
  • Managed ETL data available in different APIs, such as CRM and social networks, to provide insights into the marketing process.
  • 使用数据创建有意义的仪表板,以支持公司不同领域的决策过程.
  • 创建了一个机器学习模块,并在FastAPI端点中公开了结果.
Technologies: Apache Airflow, PostgreSQL, Amazon RDS, Amazon EC2, Python, Tableau, APIs, Snowflake, Git, GitHub, Data Pipelines, ETL, Dashboards, Business Intelligence (BI), Data Management, SQL, Windows, Visual Studio Code (VS Code), Data Analytics, Data Analysis, Analytics, Data Visualization, Databases, BI Reporting, Data Warehousing

PrestaShop Developer

2021 - 2021
Freelance
  • 通过自定义修复严重影响用户体验的性能不佳的第三方模块,对网页加载时间进行了改进.
  • 创建PrestaShop网站,存储在云位置,自定义集成,提供完整的电子商务解决方案.
  • 对网站的各个方面和功能进行了一些定制, including themes, shipping, and pricing.
  • 构建了生产和登台环境,以及用于开发和测试的简单CI/CD流程.
技术:PrestaShop, PHP, JavaScript, SQL, Windows, Visual Studio Code (VS Code)

IT Coordinator

2020 - 2021
Acesco Colombia
  • Managed high-level contracts of licensing renewal, IT assets procurement, and vendor services, 始终以最佳成本效率为目标,保持内部客户满意度.
  • 创建带有业务数据的指示板、见解和报告,用于内部分析.
  • 管理IT和安全审计,设计和执行安全策略.
Technologies: Microsoft Power BI, Power Pivot, Dashboards, Business Intelligence (BI), SQL, Windows, Visual Studio Code (VS Code), Data Analytics, Microsoft SQL Server, Data Analysis, Analytics, Data Visualization, Databases, Azure, BI Reporting, DAX, SharePoint

Automation Engineer

2011 - 2020
Acesco Colombia
  • 委托机器自动化工程数据存储网络,为机器故障和意外停机的过程变量的工程分析提供基础.
  • 协助全球技术和机器的采购过程,与供应商互动,并确保以尽可能低的成本实施最新技术.
  • 参与制造工艺设备的改造项目,以保持公司资产的理想状态.
Technologies: Siemens PLC, Variable Frequency Drive (VFD), Motion Control

Data Analytics Web App for the Water Sector in California

A data analysis app for the water sector in California. 我参与了使用Apache Airflow和pandas为数据创建ETL过程,以便在PostgreSQL AWS RDS实例中进行规范化和存储.

ETL Process for Marketing Data

存储在AWS上的Apache气流(EC2)和PostgreSQL (RDS) ETL处理系统,用于处理来自Facebook API的营销数据, client data from HubSpot API, 和几个单独的电子表格存储在谷歌表格与数据质量检查, implementation, and error reporting to generate final tables for analytical purposes.

Random Forest Model FastAPI

一个随机森林模型,用于价格预测,有一个端点来生成结果. 我是一名开发人员,在成功提取和准备产品定价数据后训练了一个随机森林模型. 我在FastAPI上创建了一个基于api的最终模型,将模型的结果公开给公司.

Data Extraction Tool for Process Engineering

用于数据采集、存储和分析的过程工程和自动化工具实现. 我是负责配置和调试实时数据采集软件的工程师. 配置TCP和UDP原始连接,并根据最佳性能和效率设计解决方案的数据存储策略.

eCommerce Website

一个基于PrestaShop开源平台的电子商务网站,用PHP编写. I was a developer and integrator of several modules and fixes, starting with theme integrations and template modifications, payment gateway configurations, and third-party shipment modules.

Languages

SQL, Python, Snowflake, PHP, JavaScript

Libraries/APIs

Pandas, Scikit-learn, TensorFlow

Tools

Microsoft Power BI, Apache Airflow, Tableau, PrestaShop, Git, Power Pivot, GitHub, Amazon QuickSight, Amazon Athena

Platforms

Amazon EC2, Ubuntu, Windows, Amazon Web Services (AWS), Azure, SharePoint, MacOS, Visual Studio Code (VS Code)

Storage

Databases, PostgreSQL, Data Pipelines, Microsoft SQL Server, Memcached, Redshift, Azure SQL Databases, Azure Blobs

Other

Windows Subsystem for Linux (WSL), Process Automation, Power Electronics, Projects, Waterfall Methodology, Siemens PLC, Variable Frequency Drive (VFD), Motion Control, ETL Tools, Data Analytics, Dashboards, Data Analysis, Analytics, Data Visualization, BI Reporting, Data Scraping, Amazon RDS, APIs, Data Quality, Data Engineering, Data Management, Data Warehousing, Azure Data Factory, DAX, Dash, Networking

Paradigms

PMBOK, ETL, Business Intelligence (BI), Data Science

2016 - 2017

Postgraduate Degree in Engineering Project Management

The University of the North - Barranquilla, Colombia

2005 - 2009

Bachelor's Degree in Electronics Engineering

The University of the North - Barranquilla, Colombia

SEPTEMBER 2021 - PRESENT

Data Science for All (DS4A)

Correlation One

Collaboration That Works

How to Work with Toptal

在数小时内,而不是数周或数月,我们的网络将为您直接匹配全球行业专家.

1

Share your needs

在与Toptal领域专家的电话中讨论您的需求并细化您的范围.
2

Choose your talent

在24小时内获得专业匹配人才的简短列表,以进行审查,面试和选择.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring