Andre Proença

About

DataOps/DevOps Engineer with 1.5 years of experience specializing in cloud data platforms, data pipeline optimization, and process automation.

Currently contributing to the transformation of data operations at a the biggest portuguese bank by migrating an on-premise data lake to Google Cloud, streamlining ingestion processes, and enhancing operational efficiency. Skilled in leveraging Google Cloud technologies and workflow orchestration to drive innovation and deliver cost-effective scalable solutions.

A little more about me

I am software engineer with a passion for solving problems and tackling new challenges.

Whenever I can, I try to explore new ways of living. I have had the opportunity to visit 19 countries, and for now, I am particularly interested in exploring southeast Asia.

Nationality: Portuguese
Languages: Portuguese (C2), English (C1), Spanish (B2), German (A1)

Expertise

DataOps: ETL, Apache Kafka, Google Cloud (BigQuery, Spanner, Pub/Sub, Looker, Composer, Storage, IAM)
DevOps: Google Cloud, Docker, Kubernetes (CKA & CKAD certified), Terraform (certification in progress)
Cloud Technologies: Google Cloud Provider (GCP) (Google Cloud Computing Foundations Certificate GCCF)
Software Development: Java8+ (Spring | SpringBoot | Quarkus | Maven | Gradle), Python (Automation, Scripting), React
Monitoring and Automation: Apache Airflow DAGs and Linux Bash Scripting
Blockchain Solutions: Hyperledger Fabric, Ethereum Network

Facts

Repositories Github

Countries visited

Languages spoken

Master Thesis Blockchain Based Residential Smart Rent

Resume

"The roots of education are bitter, but the fruit is sweet"

Aristotles

Professional Experience

DataOps Engineer

Apr 2024 - Curent

Caixa Geral de Depósitos, Lisbon, Portugal

Integrated the Bank's Data Platform Management team, acting as DataOps Engineer, entrusted with migrating an on-prem data lake to Google cloud, and innovating the team's processes.
Operated daily batch and cdc ingestions from various applications with different sources, by applying custom configurations to an ingestion framework designed to ingest to Google Cloud Data Lake (Spanner, BigQuery and Pub/Sub)
Orchestrated workflows and data pipelines by implementing Airflow DAGs in Google Composer, allowing to automate the operation of frequent ingestions from different sources.
Deployed and maintained a job in Google Cloud along with the setup of its daily trigger to compare data from multiple bank sources and validate them against Google's data lake status.
Deployed internal and external Google connectors through cloud jobs to migrate metadata from an on-prem data lake to Google's cloud metadata registry.
Entrusted to research and pitch google cloud's solution for managing personally identifiable information (PII's) within the bank's cloud data lake and operationalize its process.
Created Google Looker report to analyze and monitor daily, monthly and annual query/job costs for users and service accounts across the bank's cloud projects, enabling daily monitoring of costs and eventual reporting of overuse
Proposed and independently developed an operational process for ingesting data from Kafka topics into Google Cloud's data lake, reducing operational time by 93.3% and significantly increasing team operational availability.
Implemented an alert system using a topic in Google Pub/Sub to notify the team's corporate email of failed ingestions, improving daily monitoring and operational efficiency

Software Engineer Intern

Apr 2023 - Aug 2023

Nokia, Lisbon, Portugal

Integrated the R&D team at the Cloud and Network Services department, focused on the development of NAC (Nokia Assurance Center).
Developed and integrated React components, ensuring seamless UI layout, proper functionality, and effective interaction with backend APIs
Developed daily unit tests for React components, focusing on bug detection, enhancing reliability, achieving measurable increases in code coverage and readability
Performed functional tests using Java Cucumber and Selenium, by defining test scenarios and automating browser interactions to validate UI components and address potential bugs, assuring reliable UI behavior.
Deployed regularly Docker files with up-to-date React components to a Kubernetes cluster through Helm charts, ensuring correct and consistent increments to the NAC product.

Blockchain Engineer

Sep 2022 - Oct 2023

Unlockit, Lisbon, Portugal

Master Thesis Project (Proof Of Concept)
Partnership with INESC-ID
Built a GDPR-compliant blockchain-based residential rental platform, designed to allow landlords and tenants to establish and digitally sign rental contracts and make rental payments through stablecoins with a high level of security and transparency.
Designed a platform architecture with efficient segregation of duties, ensuring GDPR compliance, through an external database for securing personal data, secure authentication an authorization, digitally signed rental contracts, and secure crypto transactions
Configured a Kubernetes cluster to simulate a decentralized network of Hyperledger Fabric nodes, providing a robust infrastructure for blockchain operations.
Implemented platform architecture comprising a UI built in React, functionality developed in Java Spring Boot with Google OAuth2.0 integration, MongoDB communication, Hyperledger Fabric network communication to process real estate transactions and Metamask UI integration to handle payments in the Ethereum network.
Integrated metamak wallet UI and API into the platform, enabling payments in stablecoins over the Ethereum network for completing rental transactions

Blockchain Researcher

Sep 2022 - Oct 2023

INESC-ID, Lisbon, Portugal

Master Thesis Research
Partnership with Unlockit
Extensive research into blockchain platforms with particular focus on permissioned networks and their potential use cases applied to the real estate rental market.
Reported monthly progress to the thesis supervisor and to company's CEO, ensuring alignment with the master's thesis requirements, resulting in a well-oriented scientific document.
Designed a platform architecture with efficient segregation of duties, ensuring GDPR compliance, through an external database for securing personal data, secure authentication an authorization, digitally signed rental contracts, and secure crypto transactions