Transfer Learning: A Chave para Potencializar Modelos de Inteligência Artificial com Menos Dados e Tempo No cenário dinâmico da Inteligência Artificial (IA) e do aprendizado de máquina (Machine Learning - ML), a capacidade de construir modelos robustos e precisos é fundamental. Tradicionalmente, o treinamento de modelos complexos, especialmente aqueles baseados em Deep Learning, exigia vastas quantidades de dados rotulados e um poder computacional significativo, além de um tempo considerável. No entanto, uma técnica poderosa emergiu como um catalisador para superar essas limitações: o Transfer Learning (Aprendizado por Transferência). ...

Aprofundando nas Métricas de Avaliação de Modelos As métricas de avaliação de modelos são ferramentas cruciais para entender o desempenho de um algoritmo de Machine Learning após o treinamento. Elas nos fornecem uma maneira quantitativa de medir o quão bem o modelo está generalizando para novos dados e de comparar diferentes modelos ou configurações. A escolha da métrica certa depende fortemente do tipo de problema (classificação, regressão, clustering, etc.) e dos objetivos de negócio. ...

Domain 1 of this comprehensive material lays a robust foundation for understanding Artificial Intelligence (AI) and its practical implementation. It systematically breaks down fundamental AI concepts, terminologies, the Machine Learning (ML) development lifecycle, and real-world use cases. This detailed article will explore each task statement and lesson within Domain 1, providing an in-depth overview of the key takeaways. Domain 1 of this comprehensive material lays a robust foundation for understanding Artificial Intelligence (AI) and its practical implementation. It systematically breaks down fundamental AI concepts, terminologies, the Machine Learning (ML) development lifecycle, and real-world use cases. This detailed article will explore each task statement and lesson within Domain 1, providing an in-depth overview of the key takeaways. ...

Uma visão do que é o trivy e de como ele funciona. Percausos na sua implementação em pipelines e uma breve opinião na sua utilização. O que é trivy? Qual a sua proposta O que o trivy olha? Target Container Image Filesystem Git repository (remote) Kubernetes cluster or resource Scanners OS packages and software dependencies in use (SBOM) Known vulnerabilities (CVEs) IaC misconfigurations Sensitive information and secrets Como sua pipeline pode interagir com o trivy Exceções acontecem Como gerir essas exceções Obrigado Links de referencia Github do trivy - aquasecurity/trivy{:target="_blank"}

Link da apresentação deste artigo: slides{:target="_blank"} Agenda Fundamentos de IaC Infrastructure as Code Dry - Don’t repeat yourself Casos de Uso Terraform Terraform Workflow Arquivos Básico do Terraform Variables Declarando uma variavel de input Precedência de carregamento Locals Output Type Constraints Simples Complexos Functions Principais funções Providers Terraform Registry Resources Data Sources Módulos Backend Workspaces HashiCorp Certified Terraform Associate Fundamentos de IaC Infrastructure as Code Infraestrutura como código{:target="_blank"} (em inglês: infrastructure as code, ou IaC) é o processo de gerenciamento e provisionamento de centros de processamentos dados{:target="_blank"} usando arquivos{:target="_blank"} de configuração ao invés de configurações físicas de hardware ou ferramentas de configuração interativas{:target="_blank"}. ...

Artigos Understanding data transfer costs for AWS container services - Dennis Schmidt and Steve Wolfe{:target="_blank"} Threads do Twitter Cursos, bootcamps e conteúdos gratuitos - Karina Watanabe{:target="_blank"} 20 repositórios que você precisa conhecer se tornar um EXCELENTE programador(a)! - BrunoPinheiro.eth 🚀{:target="_blank"} Posts no Linkedin You must understand the Big O notation 👇 - Marc Lamberti{:target="_blank"} 😵‍💫 Data Engineering is dying? 😵‍💫 - Darshil Parmar{:target="_blank"} Slides Um guia rápido e prático para um cluster Kubernetes minimamente seguro - João Paulo da Cunha Freire{:target="_blank"} Produtos Delta Lake project announces the availability of 2.0 Release Candidate{:target="_blank"}

Artigos Criando uma API HTTP com GO (parte 1) - Vinicius Mocci{:target="_blank"} Terraform Cloud Adds Drift Detection for Infrastructure Management - MELAR CHEN{:target="_blank"} Survival of the Fittest: ETL vs. ELT - Benedetta Cittadin{:target="_blank"} Performing major version upgrades for Amazon Aurora MySQL with minimum downtime - Rajesh Matkar{:target="_blank"} Kubernetes Deep Dive: CRI (Container Runtime Interface) - Tony{:target="_blank"} Implementing Distributed Tracing in a Golang application - Ankit Anand{:target="_blank"} Posts no Linkedin Tips and Insights to engineer data using Google Cloud Platform! - POOJA JAIN{:target="_blank"} 11 pontos que acho que são importantes reflexões sobre nós mesmos como SRE e que pode ajudar na evolução do seu time - Bruno Martins{:target="_blank"} Github Scale your pandas workflows by changing one line of code - modin-project/modin{:target="_blank"} A command-line tool and Python library to efficiently diff rows across two different databases - datafold/data-diff{:target="_blank"} We would like to watch if some change happens in ConfigMap and/or Secret; then perform a rolling upgrade on relevant DeploymentConfig, Deployment, Daemonset, Statefulset and Rollout - stakater/Reloader{:target="_blank"} This codebase was created to demonstrate a fully fledged fullstack application built with Golang/Gin including CRUD operations, authentication, routing, pagination, and more - gothinkster/golang-gin-realworld-example-app{:target="_blank"} Tracee: Runtime Security and Forensics using eBPF - aquasecurity/tracee{:target="_blank"} A Simple Linux ELF Runtime Crypter. An unpacker by f0wl can be found at f0wl/ezuri_unpack. - guitmz/ezuri{:target="_blank"} Container Security Checklist: From the image to the workload - krol3/container-security-checklist{:target="_blank"} Produtos Opta - Is an infrastructure-as-code framework. Opta high-level constructs produce Terraform configuration files.{:target="_blank"} ebpf.io - Is a revolutionary technology with origins in the Linux kernel that can run sandboxed programs in an operating system kernel. It is used to safely and efficiently extend the capabilities of the kernel without requiring to change kernel source code or load kernel modules. Kill The DevOps Team - Daniel Jones{:target="_blank"} The State of Data Engineering 2022 - Einat Orr, PhD{:target="_blank"} Providers Terraform Databricks Terraform Provider Is Now Generally Available{:target="_blank"} Artigo originalmente postado em: https://afonsorodrigues.com/newsletter/links-da-semana-06/

Artigos Resolvendo problema de performance no PostgreSQL com CTE - Leandro Proença{:target="_blank"} Data Orchestration Trends: The Shift From Data Pipelines to Data Products - Simon Späti{:target="_blank"} Enabling Multi-Tenancy and Namespace Isolation in Kubernetes with NGINX - Amir Rawdat{:target="_blank"} Evolution of ML Fact Store - Vivek Kaushal{:target="_blank"} Posts no Linkedin How To Do Your First Data Engineering Project? - Darshil Parmar{:target="_blank"} Learning with SQL has come up a long way!! - POOJA JAIN{:target="_blank"} Common mistakes that junior data engineers typically do - Marc Lamberti{:target="_blank"} É Analista de dados e quer migrar para Engenharia de dados? - Rodrigo Santana Ferreira{:target="_blank"} Threads no Twitter As entrevistas para vagas internacionais (e nacionais) sempre dão aquele frio na barriga né? - Letícia Quevedo{:target="_blank"} Github The uuid package generates and inspects UUIDs based on RFC 4122 and DCE 1.1: Authentication and Security Services. - google/uuid{:target="_blank"} All of the content and slides for Danny Ma’s SQL Masterclass held at the ODSC Asia Pacific 2021 virtual conference! - DataWithDanny/sql-masterclass{:target="_blank"} A collective list of free APIs for use in software and web development. - public-api-lists/public-api-lists{:target="_blank"} Go library and command line tool to discover ip addresses of nodes in cloud environments based on meta information like tags provided by the environment. - hashicorp/go-discover{:target="_blank"} Hunt down social media accounts by username across social networks - sherlock-project/sherlock{:target="_blank"} Developer-friendly incident response with brilliant Slack integration. - grafana/oncall{:target="_blank"} Produtos roadmap.sh - is a community effort to create roadmaps, guides and other educational content to help guide the developers in picking up the path and guide their learnings.{:target="_blank"} Videos Module 3: Delta Lake 1.2 Tutorial (2022-06-14) - Delta Lake{:target="_blank"} Pílula de conhecimento by GeekHunter - dev- internacional{:target="_blank"} Modulos Terraform AWS Notify Slack Terraform module - This module creates an SNS topic (or uses an existing one) and an AWS Lambda function that sends notifications to Slack using the incoming webhooks API. - terraform-aws-modules/terraform-aws-notify-slack{:target="_blank"}

Game Firebolt - Big Data Game{:target="_blank"} Artigos Golang - Writing memory efficient and CPU optimized Go Structs - Satyajit Roy{:target="_blank"} Kubernetes monitoring with Prometheus, the ultimate guide - Mateo Burillo{:target="_blank"} Event-Driven Orchestration : Sample implementation - Brijesh Deb{:target="_blank"} Advanced concurrency patterns in Go - Karan Pratap Singh{:target="_blank"} How to Web Scrape on a Schedule with Apache Cassandra, FastAPI, and Python{:target="_blank"} Python, NoSQL & FastAPI Tutorial: Web Scraping on a Schedule - CodingEntrepreneurs{:target="_blank"} codingforentrepreneurs/Scrape-Websites-with-Python-FastAPI-Celery-NoSQL{:target="_blank"} AWS - Understand resiliency patterns and trade-offs to architect efficiently in the cloud{:target="_blank"} EMR Serverless Review - Bernardo Costa{:target="_blank"} Posts no Linkedin Python For Data Engineering - Darshil Parmar{:target="_blank"} How to prevent your DAGs from breaking each other? - Marc Lamberti{:target="_blank"} Data quality checks to your pipelines - Marc Lamberti{:target="_blank"} Threads no Twitter Você sabia que é possível adicionar SQL como uma linguagem em seu repositório? - @_MisterBento{:target="_blank"} Como melhorar no PostgreSQL uma query de 7000ms para 300ms (23x mais rápido 🚀) sem índices - @leandronsp{:target="_blank"} Github gocron: A Golang Job Scheduling Package - go-co-op/gocron{:target="_blank"} UUID package for Go language - satori/go.uuid{:target="_blank"} MindsDB ML-SQL Server enables machine learning workflows for the most powerful databases and datawarehouses using SQL - mindsdb/mindsdb{:target="_blank"} This is the first Petrobras’ repository on GitHub. It supports the 3W project and promotes experimentation of Machine Learning-based approaches and algorithms for specific problems related to undesirable events that occur in offshore oil wells- petrobras/3W{:target="_blank"} Zinc is a search engine that does full text indexing. It is a lightweight alternative to Elasticsearch and runs using a fraction of the resources - zinclabs/zinc{:target="_blank"} Produtos GitHub Skills{:target="_blank"} Introducing GitHub Skills{:target="_blank"} opencost.io{:target="_blank"} Introducing OpenCost — an Open Source Project for Monitoring Kubernetes Spend{:target="_blank"}

Artigos How eBPF Streamlines the Service Mesh - Liz Rice{:target="_blank"} GCP BigLake introduction - Neil Kolban{:target="_blank"} What is an SRE Product Manager? - António Araújo{:target="_blank"} How fast are Linux pipes anyway? - Francesco Mazzoli{:target="_blank"} Posts no Linkedin How I Use SQL as Data Engineer? - Darshil Parmar{:target="_blank"} Big Data Pipelines AWS vs. Azure vs. Google Cloud - Dr. AngShuMan Ghosh{:target="_blank"} Como criar portfólio para Data Engineering? - Rodrigo Santana Ferreira{:target="_blank"} Top 5 Github Repositories To Learn Data Science! - Deepak Sheoran{:target="_blank"} Quer se dar bem em um teste técnico para #dataengineering? - Rodrigo Santana Ferreira{:target="_blank"} Threads no Twitter Design Patterns for writing better code - @javarevisited{:target="_blank"} Resources to learn System Design - @ghumare64{:target="_blank"} 11 sites com desafios pra você praticar programação todos os dias. - @EngineerRabbit{:target="_blank"} Github [chiphuyen/ml-interviews-book - book](https://github.com/chiphuyen/ml-interviews-book){:target="_blank"} cockroachdb/pebble - Pebble is a LevelDB/RocksDB inspired key-value store focused on performance and internal usage by CockroachDB.{:target="_blank"} toniblyx/my-arsenal-of-aws-security-tools{:target="_blank"} pycaret/pycaret - An open-source, low-code machine learning library in Python{:target="_blank"} Produtos Public Cloud Services Comparison{:target="_blank"} github ilyas-it83/CloudComparer{:target="_blank"} cheat.sh - Unified access to the best community driven cheat sheets repositories of the world{:target="_blank"} github chubin/cheat.sh{:target="_blank"} Amazon EMR Serverless Now Generally Available – Run Big Data Applications without Managing Servers{:target="_blank"} Google Interview Warmup{:target="_blank"} Videos Engcast #14 - O que teremos de novidade na versão Go 1.18? - Engineering Brasil{:target="_blank"} Releases OpenSearch 2.0{:target="_blank"} GitHub is free for teams{:target="_blank"} PDFs 5 Kubernetes Backup Best Practices - Veeam{:target="_blank"} Continuous Integration Patterns and Anti-Patterns - DZone{:target="_blank"}