AWS DMS is one of the popular services used for data migration, especially for huge data migration. For the past few month, I have been working on AWS DMS service and I had many hurdles then and there. In this blog, I will be explaining various steps involved in migrating the SQL server database to … Read more
I have been working on AWS dynamoDB for a while now and every time I used to upload the JSON data to dynamoDB using a python script making use of the batch update. In many situations, I will have to convert the CSV file to JSON and then upload it to dynamoDB. So in this … Read more
In this blog, we are going to see how to download the entire files from the Amazon S3 bucket. If you are new to Amazon S3, then I recommend you to read this blog to get a high level understanding. If you are using Amazon S3 then very often you will be downloading files from … Read more
Most people use Amazon S3 to store images so that they can fetch them whenever required to display on their website. In this blog, I am going to show you the ways this can be done. In case you are someone new to AWS then take a look at this article to know what AWS is and what … Read more
AWS Lambda is one of the exciting services provided by Amazon. It provides us with a UI where we can type our code and deploy it instantly without any need for a server. In this article, let us see the things to keep in mind if you develop the code using lambda console. If you … Read more
AWS Lambda and SQS are some of the most popular services that Amazon provides. Yes, we do love them but lambda’s concurrency handling with SQS is silly. In this blog, I am going to share my experience working with them. If you are someone new to Lambda or SQS please feel free to check my … Read more
In this article, I will show the process through which you can add your backend logic using python. We will be using AWS Lambda as it blends well with Alexa. If you are someone new to AWS you can refer to this blog. Amazon Alexa makes our life easy by providing an SDK. So in … Read more
In this article, we are going to see how to reconcile the mismatching data in AWS DynamoDB and AWS OpenSearch (Elasticsearch) with the help of Amazon Redshift. In case you are wondering how to migrate the DynamoDB data to Elasticsearch in the first place, then take a look at this article. Note: This reconcile method … Read more
In this article, I will show my method of migrating the entire AWS DynamoDB table to Amazon S3 as CSV. It can further be uploaded to Amazon Redshift using the COPY command. You can also find this code on my GitHub repository. In case you are going to run this code on the local machine, … Read more
If you are someone using Elasticsearch then you may come across a situation where you need to get the entire Elasticsearch data and store it somewhere for further validation. In this article, I will help you to migrate your Elasticsearch index to Amazon S3 as a CSV file. In case you wonder why should you … Read more