Query S3 json with Athena and AWS Glue
AWS Datasync Transfer service
s3 storage service - aws certification exam tips concepts
Thoughts on using SQS with lambdas
Some random thoughts on which are the options available to integrate SQS queue with lambda processing.
Storage options S3 vs DynamoDB
The next proyect I will onboard will make heavy use of serverless technologies like S3, SNS, SQS, Step Functions and Lambdas via an API Gateway. The project as any other requires store and retrieve elements as part of processing the events.
Scheduling EC2 instances with AWS Scheduler
This post describes an out-of-the-box solution in order to schedule your resources with AWS Scheduler.
Apply CQRS pattern to build microservice with Micronaut and Kafka
The following post would describe a basic CQRS framework implementation using Micronaut. Micronaut helps us to create Kafka producers and consumers that we will use as a way to communicate events.
Building Micronaut serverless AWS Functions and integration with microservices
The following post would explore how Micronaut enables developement of serverless functions and integration with AWS Lambda as cloud providers.
Using grpc as an alternative to REST for comms among microservices
Using gRpc as an alternative to REST for inter service communication among microservices.
Deploying Micronaut microservices into Kubernetes (Part III)
This post will show steps to deploy microservices into Kubernetes. We will use our previous Beer + Micronaut framework microservices examples so I recommend catching up with previous articles.
Building microservices with Micronaut (Part II)
The second post around microservices with Micronaut framework will explore distributed configuration, distributed tracing and server side events
Building microservices with Micronaut (Part I)
This blog series around microservices with Micronaut framework will see how it can help to speed up development in a microservices architecture using patterns such Service Discovery and Registration, circuit breaker and retries
Jenkins Pipeline integration with Slack
The following post describes a step by step guide to include ChatOps in your project using Jenkins and Slack.
Considerations when working with Amazon S3 .
We use S3 to store stuff in the cloud, but there are a few things that not everyone maybe aware of. The following post is just a scratchpad / notes on some items I have learnt while working with AWS S3 in the last month.
Useful bash commands tools to increase your productivity as a developer
Using the right tool for the job can make a difference on your productivity as developer. I will share some pointers about awesome bash tools that can help you to master effectively your daily work as developer.
Building microservices with Go, Gin and NATS
This post describes a simple approach to build microservices using Go language. On the way we will apply
Serverless function using OpenFaaS, NodeJS and mongoDB.
I will describe how to deploy a new NodeJs function into OpenFaaS using Docker Swarm stack. The function will be written in NodeJs and speak to MongoDB to read/write data.
Functions as a service with OpenFaas
OpenFaaS is a framework for packaging code, binaries or containers as Serverless functions on any platform.
Understanding Kubernetes Controllers
We will go through different types of controllers: Replication Controllers, ReplicaSet, Deployments. We also see how some operation tasks like autoscaling or rolling updates can be achieved using Kubernetes.
Understanding AWS Elemental MediaConvert
Quick summary on AWS Elemental MediaConvert announced recently in Amazon ReInvent:2017
Deep dive and best practices on AWS Lambdas
The following post will attempt to go through best practices, networking and things to bear in mind while developing with AWS lambdas
Improving acceptance testing using AWS CloudFormation, S3, Jenkins and Docker
I will describe how we improved our automation testing cycle using CloudFormation, S3, Jenkins and Docker.
Understanding Kubernetes Pods
We will learn what are pods, its lifecycle and several ways of managing them running directly, declaratively using yaml manifests or other alternatives.
Installing Kubernetes using Minicube
The following item walks through how to setup a K8 cluster on my laptop. I will using Minikube
Kubernetes vs Swarm
This post will go through a brief introduction to K8 and see how it stands against Docker Swarm. o
Docker toolset to inspect your containers Sen, Portainer and caDvisor
A very short post showing some tools that can help you managing your docker containers in a intuitive way. We will see a terminal management tool, a nice web UI Portainer and a monitoring tool: caAdvisor from Google.
Monitoring docker containers using prometheus and grafana
We have already covered in previous posts the usage of tools via docker starting from building tools, continuous integration, integration testing. Now is time to share some thoughts about how easy is getting insights of our containers without modifying our applications using Grafana and prometheus
Log aggregation alternatives using docker - Elastic Search stack
This post is a continuation on a series of posts about using Docker to integrate our application logs. We will use ElasticSearch, Logstash and Kibana using docker-compose
Log aggregation alternatives using docker - Using papertrail
I will explore in a series of post how Docker can be used to detect proactively errors via logging monitoring. First I will use Papertrail as a SaaS solution, but the space is crowded of multiple alternatives to be explored.
Build your JAVA code with maven within a Docker container
The following post will show how developers could benefit of using Docker on the development cycle. Docker can be used not only to improve deployment processes or to be part of
Run integration tests using docker and junit
In this post I will share the steps that I followed to achieve integration testing that can be launched from your favourite IDE or run locally or in a CI server via maven using palantir Docker compose junit rules.
Building a CD pipeline with docker and jenkins
My objective is prototype a CD flow with several stages including manual steps before the artifacts are released and deployed to each stage. In a continuous deployment flow there are several points where QA may need to perform several regression testing or manual tests before signing off a release.
Using private docker registry alternatives!
Running containers within containers and using private registries implies some configuration issues. Several options were tried including
- insecure registries
- registry proxied by nginx to setup TLS negotiation
- registry images using certs and CA crts.