12/05/2025 updated


100 % available
Solutions Architect, Big Data Platform Engineer, Big Data Engineer
Pololo, Spain
Only remote
About me
I’m a Cloud Solution Architect with more of a decade of experience designing and implementing scalable, secure, and automated cloud infrastructures across Azure, AWS, and GCP. My focus is to bridge the gap between business strategy and technical execution.
Testing (Software)Java (Programming Language)PHPAcceptance TestingActive DirectoryApplication Programming Interfaces (APIs)IBM AIXAmazon Web ServicesAmazon S3Analytic ApplicationsData AnalysisApache HTTP ServerApache TomcatApplication Configuration Access ProtocolsIBM System I
Tier 3, UAT, Active Directory, Alteryx, Redshift, S3, VPC, AWS, AWS architecture, Ambari, Ansible, Flink, HBase, Apache, Hadoop, Hive, Apache Hive, Kafka, Apache Maven, Apache NiFi, NiFi, Oozie, Solr, Spark, Apache Spark, Tomcat, YARN, Application Configuration, API, APIs, Backup solutions, backups, Baseline, Bash, bash scripting, Big Data, BigData, BGP, analytic tools, CPanel, Cassandra, client Server, Cloud Services, cloud-based, cloud, Cloudera, Impala, CloudFormation, Configuration management, CI/CD, Continuous integration, CRUD, Analytics, Datacenter, Data integration, Data Lake, Data layer, logging, Data Mart, DataMart, Storage management, DataFlow, data solutions, Data Vault, Data Warehousing, Database, Debian, computers, DevOps, Dev Ops, distributed data, distributed computing, Docker, DNS, Event Driven Architecture, ETL, sFTP, Firewall, front-end, Git, Github, GitLab, GCP, Grafana, application monitoring, HDFS, AIX, IBM STORAGE, AS/400, IBM WebSphere, WebSphere, IT Governance, IAM, Data Engineering, IT sector, information technology, IaaS, IIS, iptables, JSON, JAVA, Java JDK, Jenkins, Kerberos, KVM, Kubernetes, laptops, LDAP, Linux, Linux command, Linux Security, Linux Administration, LVM, Mail Server, Microstrategy, Microservices, Azure, office, SQL Server, Windows NT server, windows, Middleware, MongoDB, MySQL, MySQL databases, Nagios, Network Administrator, network connectivity, servers, network services, nginx, NoSQL, Novell, office applications, Open Enterprise Server, Open Source, OpenLDAP, Openshift, operational systems, operating systems, php, peripherals, perl, PaaS, postfix, PowerBI, Prometheus, Puppet, Python, Qlikview, RAID, hardware RAID, RSTUDIO, RHEL, Linux RedHat, RHEL5, Routing, SAS, SQL, SSIS, SUSE Linux, SAMBA, SAS Visual Analytics, Scala, Scripting, SELinux, server support, design patterns, Software Engineering, application development, Version Control, SourceTree, Spark Streaming, Spotfire, Sqoop, squid, Subnets, SVN, SWAGGER, Syslog, high availability, Tableau, Talend, Terraform, Test Data, Software tester, SSL, Ubuntu, UNIX, User management, authentication, VLANs, virtual machines, VPN, Virtualbox, Virtualization, vmware, web pages, Webservices, JBoss, PowerShell, Windows Server, Windows 2012, WordPress, workbooks, WSUS, YAML
Experience
Professional experience10+ years
Freelancer since2020
Languages
EnglishFluentPortugueseGoodSpanishNative speaker
Project history
Motivate and enable our customers on their Enterprise Data Cloud journey
Participate in the pre and post sales process, helping both the sales and
product teams to interpret customer use cases
Drive POCs with customers to successful completion
Design and implement Enterprise Data Cloud architectures and configurations
for customers
Work directly with customer technical resources to devise, recommend and
implement solutions based on the understood requirements
Recommend best practice design patterns for distributed data pipelines and
analytical computing architectures
Plan and deliver presentations and workshops to customer/internal
stakeholders
Mentor junior consultants
Assist in the technical hiring process
Write and produce technical documentation, blogs and knowledgebase articles
Work directly with customer's technical resources to devise and recommend
solutions based on the understood requirements
Analyze complex distributed production deployments, and make
recommendations to optimize performance
Able to document and present complex architectures for the customers
technical teams
Work closely with Cloudera's teams at all levels to help ensure the success of
project consulting engagements with customer
Help design and implement Hadoop architectures and configurations for
customer
Drive projects with customers to successful completion
Write and produce technical documentation, knowledge base articles
Participate in the pre-and postsales process, helping both the sales and
product teams to interpret customers' requirements.
Keep current with the Hadoop Big Data ecosystem technologies.
Attend speaking engagements when needed.
Participate in the pre and post sales process, helping both the sales and
product teams to interpret customer use cases
Drive POCs with customers to successful completion
Design and implement Enterprise Data Cloud architectures and configurations
for customers
Work directly with customer technical resources to devise, recommend and
implement solutions based on the understood requirements
Recommend best practice design patterns for distributed data pipelines and
analytical computing architectures
Plan and deliver presentations and workshops to customer/internal
stakeholders
Mentor junior consultants
Assist in the technical hiring process
Write and produce technical documentation, blogs and knowledgebase articles
Work directly with customer's technical resources to devise and recommend
solutions based on the understood requirements
Analyze complex distributed production deployments, and make
recommendations to optimize performance
Able to document and present complex architectures for the customers
technical teams
Work closely with Cloudera's teams at all levels to help ensure the success of
project consulting engagements with customer
Help design and implement Hadoop architectures and configurations for
customer
Drive projects with customers to successful completion
Write and produce technical documentation, knowledge base articles
Participate in the pre-and postsales process, helping both the sales and
product teams to interpret customers' requirements.
Keep current with the Hadoop Big Data ecosystem technologies.
Attend speaking engagements when needed.
Event Driven Architecture:
Development of POC streaming: using Kafka for data messaging, Flink for
data processing and mapping.
+Define requirements for Event Driven Architecture using NIFI on a Cloudera
Cluster.
*Optimize Kafka Producer API with authentication and cluster Management
*Clarified Kafka Subscriber API
*Define requirements for Test Data Management
*Implement common cache API
+Define evaluation criteries to compare Flink and Spark Streaming with NiFi
+Compare Flink and Spark Streaming
Technologies used; FLINK, KAFKA, NIFI, SCHEMA REGISTRY, SWAGGER,
SCALA, CLOUDERA.
Development of POC streaming: using Kafka for data messaging, Flink for
data processing and mapping.
+Define requirements for Event Driven Architecture using NIFI on a Cloudera
Cluster.
*Optimize Kafka Producer API with authentication and cluster Management
*Clarified Kafka Subscriber API
*Define requirements for Test Data Management
*Implement common cache API
+Define evaluation criteries to compare Flink and Spark Streaming with NiFi
+Compare Flink and Spark Streaming
Technologies used; FLINK, KAFKA, NIFI, SCHEMA REGISTRY, SWAGGER,
SCALA, CLOUDERA.
Migration of the current Cloudera CDH to CDP to AWS. -Deploy 5 new cluster
for the upcoming demands.
* Support the Big Data platform (Spark, Hive, etc.)
* Linux, Kerberos, scripting with Bash & Python
* DevOps approach with Git and Ansible to manage clusters
Existing and upcoming Data technologies : Hadoop, Scala, Spark, Kafka, SQL,
Flink, Cassandra, ELK,
Designing and building cloud-based data solutions and more specifically with
AWS (IAM, S3, Glue, EMR, EKS, Sagemaker, ...).
Data integration/movement platform specialist with experience in performing
following activities:
NiFi: Establishing enterprise-level framework: automating intake procedure,
promotion and smaller components (GitLab)
Establishing monitoring and alerting solutions on cluster level with Open
Source solutions.
CFM (Cloudera NiFi) Implementation.
Setting up E2E NiFi environments on the cloud
Deployment of Cloudera Private Cloud Base
Establishing and Automating enterprise-level framework. CDP 7.x
Migration of CDH workloads. Cluster Management, upgrades, expansions,etc.
Kafka:
E2E setting up Kafka environments (Brokers, Connect, SchemaRegistry,
Kerberos, MirrorMaker)
Setting up monitoring (Lenses, Prometheus, Grafana, ELK ...)
Setting up security (SASL/GSSAPI, SSL)
Kubernetes deployments of Kafka component
Setting up E2E Kafka environments
( Brokers,Connect,SchemaRegistry,Kerberos, mTLS,MirroMaker) on the cloud (AWS)
Technology stack:
* Kafka Stack, NiFi, Kerberos, Openshift, Hadoop Stack, Kudu, Impala, Python,
Ranger, Knox, Gitlab
Prometheus + Grafana, Terraform, AWS and GCP .
for the upcoming demands.
* Support the Big Data platform (Spark, Hive, etc.)
* Linux, Kerberos, scripting with Bash & Python
* DevOps approach with Git and Ansible to manage clusters
Existing and upcoming Data technologies : Hadoop, Scala, Spark, Kafka, SQL,
Flink, Cassandra, ELK,
Designing and building cloud-based data solutions and more specifically with
AWS (IAM, S3, Glue, EMR, EKS, Sagemaker, ...).
Data integration/movement platform specialist with experience in performing
following activities:
NiFi: Establishing enterprise-level framework: automating intake procedure,
promotion and smaller components (GitLab)
Establishing monitoring and alerting solutions on cluster level with Open
Source solutions.
CFM (Cloudera NiFi) Implementation.
Setting up E2E NiFi environments on the cloud
Deployment of Cloudera Private Cloud Base
Establishing and Automating enterprise-level framework. CDP 7.x
Migration of CDH workloads. Cluster Management, upgrades, expansions,etc.
Kafka:
E2E setting up Kafka environments (Brokers, Connect, SchemaRegistry,
Kerberos, MirrorMaker)
Setting up monitoring (Lenses, Prometheus, Grafana, ELK ...)
Setting up security (SASL/GSSAPI, SSL)
Kubernetes deployments of Kafka component
Setting up E2E Kafka environments
( Brokers,Connect,SchemaRegistry,Kerberos, mTLS,MirroMaker) on the cloud (AWS)
Technology stack:
* Kafka Stack, NiFi, Kerberos, Openshift, Hadoop Stack, Kudu, Impala, Python,
Ranger, Knox, Gitlab
Prometheus + Grafana, Terraform, AWS and GCP .