Newsletter

Artigos Understanding data transfer costs for AWS container services - Dennis Schmidt and Steve Wolfe{:target="_blank"} Threads do Twitter Cursos, bootcamps e conteúdos gratuitos - Karina Watanabe{:target="_blank"} 20 repositórios que você precisa conhecer se tornar um EXCELENTE programador(a)! - BrunoPinheiro.eth 🚀{:target="_blank"} Posts no Linkedin You must understand the Big O notation 👇 - Marc Lamberti{:target="_blank"} 😵‍💫 Data Engineering is dying? 😵‍💫 - Darshil Parmar{:target="_blank"} Slides Um guia rápido e prático para um cluster Kubernetes minimamente seguro - João Paulo da Cunha Freire{:target="_blank"} Produtos Delta Lake project announces the availability of 2.0 Release Candidate{:target="_blank"}

Artigos Criando uma API HTTP com GO (parte 1) - Vinicius Mocci{:target="_blank"} Terraform Cloud Adds Drift Detection for Infrastructure Management - MELAR CHEN{:target="_blank"} Survival of the Fittest: ETL vs. ELT - Benedetta Cittadin{:target="_blank"} Performing major version upgrades for Amazon Aurora MySQL with minimum downtime - Rajesh Matkar{:target="_blank"} Kubernetes Deep Dive: CRI (Container Runtime Interface) - Tony{:target="_blank"} Implementing Distributed Tracing in a Golang application - Ankit Anand{:target="_blank"} Posts no Linkedin Tips and Insights to engineer data using Google Cloud Platform! - POOJA JAIN{:target="_blank"} 11 pontos que acho que são importantes reflexões sobre nós mesmos como SRE e que pode ajudar na evolução do seu time - Bruno Martins{:target="_blank"} Github Scale your pandas workflows by changing one line of code - modin-project/modin{:target="_blank"} A command-line tool and Python library to efficiently diff rows across two different databases - datafold/data-diff{:target="_blank"} We would like to watch if some change happens in ConfigMap and/or Secret; then perform a rolling upgrade on relevant DeploymentConfig, Deployment, Daemonset, Statefulset and Rollout - stakater/Reloader{:target="_blank"} This codebase was created to demonstrate a fully fledged fullstack application built with Golang/Gin including CRUD operations, authentication, routing, pagination, and more - gothinkster/golang-gin-realworld-example-app{:target="_blank"} Tracee: Runtime Security and Forensics using eBPF - aquasecurity/tracee{:target="_blank"} A Simple Linux ELF Runtime Crypter. An unpacker by f0wl can be found at f0wl/ezuri_unpack. - guitmz/ezuri{:target="_blank"} Container Security Checklist: From the image to the workload - krol3/container-security-checklist{:target="_blank"} Produtos Opta - Is an infrastructure-as-code framework. Opta high-level constructs produce Terraform configuration files.{:target="_blank"} ebpf.io - Is a revolutionary technology with origins in the Linux kernel that can run sandboxed programs in an operating system kernel. It is used to safely and efficiently extend the capabilities of the kernel without requiring to change kernel source code or load kernel modules. Kill The DevOps Team - Daniel Jones{:target="_blank"} The State of Data Engineering 2022 - Einat Orr, PhD{:target="_blank"} Providers Terraform Databricks Terraform Provider Is Now Generally Available{:target="_blank"} Artigo originalmente postado em: https://afonsorodrigues.com/newsletter/links-da-semana-06/

Artigos Resolvendo problema de performance no PostgreSQL com CTE - Leandro Proença{:target="_blank"} Data Orchestration Trends: The Shift From Data Pipelines to Data Products - Simon Späti{:target="_blank"} Enabling Multi-Tenancy and Namespace Isolation in Kubernetes with NGINX - Amir Rawdat{:target="_blank"} Evolution of ML Fact Store - Vivek Kaushal{:target="_blank"} Posts no Linkedin How To Do Your First Data Engineering Project? - Darshil Parmar{:target="_blank"} Learning with SQL has come up a long way!! - POOJA JAIN{:target="_blank"} Common mistakes that junior data engineers typically do - Marc Lamberti{:target="_blank"} É Analista de dados e quer migrar para Engenharia de dados? - Rodrigo Santana Ferreira{:target="_blank"} Threads no Twitter As entrevistas para vagas internacionais (e nacionais) sempre dão aquele frio na barriga né? - Letícia Quevedo{:target="_blank"} Github The uuid package generates and inspects UUIDs based on RFC 4122 and DCE 1.1: Authentication and Security Services. - google/uuid{:target="_blank"} All of the content and slides for Danny Ma’s SQL Masterclass held at the ODSC Asia Pacific 2021 virtual conference! - DataWithDanny/sql-masterclass{:target="_blank"} A collective list of free APIs for use in software and web development. - public-api-lists/public-api-lists{:target="_blank"} Go library and command line tool to discover ip addresses of nodes in cloud environments based on meta information like tags provided by the environment. - hashicorp/go-discover{:target="_blank"} Hunt down social media accounts by username across social networks - sherlock-project/sherlock{:target="_blank"} Developer-friendly incident response with brilliant Slack integration. - grafana/oncall{:target="_blank"} Produtos roadmap.sh - is a community effort to create roadmaps, guides and other educational content to help guide the developers in picking up the path and guide their learnings.{:target="_blank"} Videos Module 3: Delta Lake 1.2 Tutorial (2022-06-14) - Delta Lake{:target="_blank"} Pílula de conhecimento by GeekHunter - dev- internacional{:target="_blank"} Modulos Terraform AWS Notify Slack Terraform module - This module creates an SNS topic (or uses an existing one) and an AWS Lambda function that sends notifications to Slack using the incoming webhooks API. - terraform-aws-modules/terraform-aws-notify-slack{:target="_blank"}

Game Firebolt - Big Data Game{:target="_blank"} Artigos Golang - Writing memory efficient and CPU optimized Go Structs - Satyajit Roy{:target="_blank"} Kubernetes monitoring with Prometheus, the ultimate guide - Mateo Burillo{:target="_blank"} Event-Driven Orchestration : Sample implementation - Brijesh Deb{:target="_blank"} Advanced concurrency patterns in Go - Karan Pratap Singh{:target="_blank"} How to Web Scrape on a Schedule with Apache Cassandra, FastAPI, and Python{:target="_blank"} Python, NoSQL & FastAPI Tutorial: Web Scraping on a Schedule - CodingEntrepreneurs{:target="_blank"} codingforentrepreneurs/Scrape-Websites-with-Python-FastAPI-Celery-NoSQL{:target="_blank"} AWS - Understand resiliency patterns and trade-offs to architect efficiently in the cloud{:target="_blank"} EMR Serverless Review - Bernardo Costa{:target="_blank"} Posts no Linkedin Python For Data Engineering - Darshil Parmar{:target="_blank"} How to prevent your DAGs from breaking each other? - Marc Lamberti{:target="_blank"} Data quality checks to your pipelines - Marc Lamberti{:target="_blank"} Threads no Twitter Você sabia que é possível adicionar SQL como uma linguagem em seu repositório? - @_MisterBento{:target="_blank"} Como melhorar no PostgreSQL uma query de 7000ms para 300ms (23x mais rápido 🚀) sem índices - @leandronsp{:target="_blank"} Github gocron: A Golang Job Scheduling Package - go-co-op/gocron{:target="_blank"} UUID package for Go language - satori/go.uuid{:target="_blank"} MindsDB ML-SQL Server enables machine learning workflows for the most powerful databases and datawarehouses using SQL - mindsdb/mindsdb{:target="_blank"} This is the first Petrobras’ repository on GitHub. It supports the 3W project and promotes experimentation of Machine Learning-based approaches and algorithms for specific problems related to undesirable events that occur in offshore oil wells- petrobras/3W{:target="_blank"} Zinc is a search engine that does full text indexing. It is a lightweight alternative to Elasticsearch and runs using a fraction of the resources - zinclabs/zinc{:target="_blank"} Produtos GitHub Skills{:target="_blank"} Introducing GitHub Skills{:target="_blank"} opencost.io{:target="_blank"} Introducing OpenCost — an Open Source Project for Monitoring Kubernetes Spend{:target="_blank"}

Artigos How eBPF Streamlines the Service Mesh - Liz Rice{:target="_blank"} GCP BigLake introduction - Neil Kolban{:target="_blank"} What is an SRE Product Manager? - António Araújo{:target="_blank"} How fast are Linux pipes anyway? - Francesco Mazzoli{:target="_blank"} Posts no Linkedin How I Use SQL as Data Engineer? - Darshil Parmar{:target="_blank"} Big Data Pipelines AWS vs. Azure vs. Google Cloud - Dr. AngShuMan Ghosh{:target="_blank"} Como criar portfólio para Data Engineering? - Rodrigo Santana Ferreira{:target="_blank"} Top 5 Github Repositories To Learn Data Science! - Deepak Sheoran{:target="_blank"} Quer se dar bem em um teste técnico para #dataengineering? - Rodrigo Santana Ferreira{:target="_blank"} Threads no Twitter Design Patterns for writing better code - @javarevisited{:target="_blank"} Resources to learn System Design - @ghumare64{:target="_blank"} 11 sites com desafios pra você praticar programação todos os dias. - @EngineerRabbit{:target="_blank"} Github [chiphuyen/ml-interviews-book - book](https://github.com/chiphuyen/ml-interviews-book){:target="_blank"} cockroachdb/pebble - Pebble is a LevelDB/RocksDB inspired key-value store focused on performance and internal usage by CockroachDB.{:target="_blank"} toniblyx/my-arsenal-of-aws-security-tools{:target="_blank"} pycaret/pycaret - An open-source, low-code machine learning library in Python{:target="_blank"} Produtos Public Cloud Services Comparison{:target="_blank"} github ilyas-it83/CloudComparer{:target="_blank"} cheat.sh - Unified access to the best community driven cheat sheets repositories of the world{:target="_blank"} github chubin/cheat.sh{:target="_blank"} Amazon EMR Serverless Now Generally Available – Run Big Data Applications without Managing Servers{:target="_blank"} Google Interview Warmup{:target="_blank"} Videos Engcast #14 - O que teremos de novidade na versão Go 1.18? - Engineering Brasil{:target="_blank"} Releases OpenSearch 2.0{:target="_blank"} GitHub is free for teams{:target="_blank"} PDFs 5 Kubernetes Backup Best Practices - Veeam{:target="_blank"} Continuous Integration Patterns and Anti-Patterns - DZone{:target="_blank"}

Links Nginx - Announcing Version 1.0.0 - Nginx Modern Apps Reference Architecture{:target="_blank"} Modern Data Platform - How to build one? - Anil Madan{:target="_blank"} Performing Data Validation at Scale with Soda Core - Mahdi Karabiben{:target="_blank"} Managed Kafka services: Which is right for you? - Bilgin Ibryam{:target="_blank"} Understanding 8 types of Cross-Validation - Satyam Kumar{:target="_blank"} Posts no Linkedin Você já se deparou com aquele desenvolvedor que sempre escolhe as mesmas tecnologias em todos os system designs? - Douglas Rocha{:target="_blank"} My favorite resources to keep improving yourself as a Data Engineer in 2022? - Marcos Ortiz Valmaseda{:target="_blank"} Boas práticas de SQL - Rodrigo Santana Ferreira{:target="_blank"} Now anyone can learn AWS skills and earn AWS digital badges for FREE! - Viktoria Semaan{:target="_blank"} Github k0kubun/sqldef - The easiest idempotent MySQL/PostgreSQL/SQLite3/SQL Server schema management by SQL{:target="_blank"} Este projeto eu achei muito interessante, muito legal o conceito de idepotencia na evolução do schema do seu banco. madhuakula/kubernetes-goat - The Kubernetes Goat is designed to be an intentionally vulnerable cluster environment to learn and practice Kubernetes security{:target="_blank"} Treinamentos AWS Cloud Practitioner Essentials (Portuguese - skillbuilder.aws){:target="_blank"} Passagem do Livro SRE do Google The Four Golden Signals{:target="_blank"} Stackoverflow How to increase _cluster/settings/cluster.max_shards_per_node for AWS Elasticsearch Service{:target="_blank"} Produtos Tetragon - eBPF-based Security Observability & Runtime Enforcement - Isovalent{:target="_blank"} Databricks SQL on Google Cloud – Now in Public Preview{:target="_blank"} Videos Challenge State of Data: O que você precisa saber para ganhar a competição e levar o PS5 pra casa -Data Hackers{:target="_blank"}

Artigos Cinco de Trino - Starburst{:target="_blank"} Como a Loft lida com governança e qualidade na plataforma de dados{:target="_blank"} A slice of life: table partitioning in PostgreSQL databases{:target="_blank"} Data quality with Soda.io at americanas{:target="_blank"} Data Quality Monitoring is Dead. Say Hello to Full Data Stack Observability{:target="_blank"} What is a Feature Store?{:target="_blank"} Unlocking our data with a feature store{:target="_blank"} Lift your MLOps pipeline to the cloud with Feast and Astra DB{:target="_blank"} Build a DataOps platform to break silos between engineers and analysts{:target="_blank"} Posts do linkedin How is a Data Lakehouse different from a Data Warehouse? - Vini Jaiswal{:target="_blank"} Data Observability is paramount to any Modern Data Stack - Marc Lamberti{:target="_blank"} Data Engineer e algumas tarrefas importantes - Rodrigo Santana Ferreira{:target="_blank"} Videos Acelerando desenvolvimento de pipelines de dados no Inter com o DEDE framework - Meetup Engenharia de Dados{:target="_blank"} Produtos soda.io - Data Reliability Engineering as Code{:target="_blank"} RLLIB - Scalable, state of the art reinforcement learning{:target="_blank"} Podcast #12 Data Mesh: a última tendência em arquitetura de dados - Data On Air{:target="_blank"} Ebook Cassandra: The Definitive Guide - 3rd Edition - O’Reilly{:target="_blank"} Repositórios Go Concurrency Guide - luk4z7/go-concurrency-guide{:target="_blank"} Terraform State Storage HTTP Backend - tfstate/github-sls-rest-api{:target="_blank"} Curso de monitoração com o Prometheus - cirolini/prometheus-curso-monitoring{:target="_blank"} mlflow/mlflow{:target="_blank"} Workshops One Observability Workshop - X-Ray, OpenTelemetry, Prometheus{:target="_blank"}