https://ronaldbradford.com/categories/amazon-web-services-aws/ Recent content in Amazon Web Services (AWS) on Enterprise Data Architect | Principal Data Strategist | MySQL Subject Matter Expert | Author | Speaker Hugo -- gohugo.io en-us Wed, 13 Mar 2024 20:04:32 +0000 https://ronaldbradford.com/blog/digital-tech-trek-digest-11-2024-03-13/ Wed, 13 Mar 2024 20:04:32 +0000 https://ronaldbradford.com/blog/digital-tech-trek-digest-11-2024-03-13/ In his Newsletter Solopreneur Ian Nuttal writes, “I sold my startup (again).” In 4 months URL Monitor scaled far beyond what I expected: 550+ customers 2 million indexed pages 17 million pages monitored https://ronaldbradford.com/blog/digital-tech-trek-digest-5-2-2024-01-31/ Wed, 31 Jan 2024 21:49:48 +0000 https://ronaldbradford.com/blog/digital-tech-trek-digest-5-2-2024-01-31/ Because the world needs better dashboards While my professional interests in Building Better Data Insights Faster rely on using visuals and narratives to show data-driven results, “Starting from first principles” is the question you have to ask. https://ronaldbradford.com/blog/digital-tech-trek-digest-1-2024-01-03/ Wed, 03 Jan 2024 16:33:31 +0000 https://ronaldbradford.com/blog/digital-tech-trek-digest-1-2024-01-03/ The Tiny Stack (Astro, SQLite, Litestream) I spent many years in the LAMP stack , and there are often many more acronyms of technology stacks in our evolving programming ecosystem. New today is “The Tiny Stack”, consisting of Astro , a modern meta-framework for javascript (not my words), and Lightstream Continuously stream SQLite changes. https://ronaldbradford.com/blog/announcing-instancehunt-2024-01-02/ Tue, 02 Jan 2024 16:57:08 +0000 https://ronaldbradford.com/blog/announcing-instancehunt-2024-01-02/ InstanceHunt identifies the instance (families/types/classes) available for a cloud service across all the regions of that cloud. The initial version is a working example of several AWS database services. Future releases will enable advanced filtering and will cover other service categories (e. https://ronaldbradford.com/blog/aws-rds-aurora-wish-list-2022-09-28/ Wed, 28 Sep 2022 21:24:33 +0000 https://ronaldbradford.com/blog/aws-rds-aurora-wish-list-2022-09-28/ I’ve had this list on a post-it note on my monitor for all of 2022. I figured it was time to write it down, and reuse the space. In summary, AWS suffers from the same problem that almost every other product does. https://ronaldbradford.com/blog/spoiler-owning-your-data-isnt-good-enough-2022-09-04/ Sun, 04 Sep 2022 20:38:37 +0000 https://ronaldbradford.com/blog/spoiler-owning-your-data-isnt-good-enough-2022-09-04/ While this is a catchy title, if you use Software as a Service (SaaS), or an online cloud provider, do you actually own and have total control of your business data and its infrastructure? https://ronaldbradford.com/blog/can-a-picture-replace-a-text-description-2022-08-25/ Fri, 26 Aug 2022 01:08:33 +0000 https://ronaldbradford.com/blog/can-a-picture-replace-a-text-description-2022-08-25/ Data visualization, data storytelling, and data lineage are all ways to better describe and visualize a specific situation for a set of data. Generally, I find these techniques are used as a means to uncover or identify information that ultimately pertains to individuals. https://ronaldbradford.com/blog/upgrading-to-aws-aurora-mysql-8-2021-12-19/ Sun, 19 Dec 2021 21:03:13 +0000 https://ronaldbradford.com/blog/upgrading-to-aws-aurora-mysql-8-2021-12-19/ With Aurora MySQL 8 now generally available to all, you may want to consider the plan for an upgrade path if you would like to take advantage of the new features for your application, for example, Common Table Expressions (CTE). https://ronaldbradford.com/blog/aws-aurora-mysql-8-is-now-generally-available-2021-12-02/ Thu, 02 Dec 2021 13:53:24 +0000 https://ronaldbradford.com/blog/aws-aurora-mysql-8-is-now-generally-available-2021-12-02/ AWS has just announced the general availability of Aurora MySQL 8 compatibility (known as Aurora Version 3). This is long awaited addition to RDS MySQL 8 and provides many of the new features that can be found in the open-source MySQL 8 community version. https://ronaldbradford.com/blog/wdiltw-rtfm-then-rtfm-again-then-improve-it-2021-05-18/ Wed, 19 May 2021 02:17:31 +0000 https://ronaldbradford.com/blog/wdiltw-rtfm-then-rtfm-again-then-improve-it-2021-05-18/ This week I learned two valuable aspects of Terraform I did not know. The first is Terraform State Import . While I use terraform state to list and show state and even remove state, I was unaware you could import from a created AWS resource. https://ronaldbradford.com/blog/a-qldb-cheat-sheet-for-mysql-users-2021-05-13/ Thu, 13 May 2021 16:00:31 +0000 https://ronaldbradford.com/blog/a-qldb-cheat-sheet-for-mysql-users-2021-05-13/ The AWS ledger database (QLDB) is an auditors best friend and lives up to the stated description of “Amazon QLDB can be used to track each and every application data change and maintains a complete and verifiable history of changes over time. https://ronaldbradford.com/blog/understanding-aws-rds-aurora-capabilities-2021-05-13/ Thu, 13 May 2021 16:00:27 +0000 https://ronaldbradford.com/blog/understanding-aws-rds-aurora-capabilities-2021-05-13/ The RDS Aurora MySQL/PostgreSQL capabilities of AWS extend the High Availability (HA) capabilities of RDS read replicas and Multi-AZ. In this presentation I discuss the different capabilities and HA configurations with RDS Aurora including: https://ronaldbradford.com/blog/upcoming-percona-live-2021-presentations-2021-04-23/ Fri, 23 Apr 2021 14:35:08 +0000 https://ronaldbradford.com/blog/upcoming-percona-live-2021-presentations-2021-04-23/ I am pleased to have been selected to present at Percona Live 2021 May 12-13. My presentations include talks on AWS RDS Aurora and QLDB managed services. Understanding AWS RDS Aurora Capabilities The RDS Aurora MySQL/PostgreSQL capabilities of AWS extend the HA capabilities of RDS read replicas and Multi-AZ. https://ronaldbradford.com/blog/wdiltw-creating-examples-can-be-hard-2021-03-06/ Sun, 07 Mar 2021 01:59:31 +0000 https://ronaldbradford.com/blog/wdiltw-creating-examples-can-be-hard-2021-03-06/ This week I was evaluating AWS QLDB . Specifically the verifiable history of changes to determine how to simplify present processes that perform auditing via CDC. This is not the first time I have looked at QLDB so there was nothing that new to learn. https://ronaldbradford.com/blog/wdiltw-what-can-i-run-from-my-aws-aurora-database-2021-02-26/ Fri, 26 Feb 2021 21:12:28 +0000 https://ronaldbradford.com/blog/wdiltw-what-can-i-run-from-my-aws-aurora-database-2021-02-26/ When you work with AWS Aurora you have limited admin privileges. There are some different grants for MySQL including SELECT INTO S3 and LOAD FROM S3 that replace the loss of functionality to SELECT INTO OUTFILE and mysqldump/mysqlimport using a delimited format. https://ronaldbradford.com/blog/wdiltw-debugging-failed-http-requests-thru-the-web-of-redirects-2021-02-12/ Sat, 13 Feb 2021 03:27:21 +0000 https://ronaldbradford.com/blog/wdiltw-debugging-failed-http-requests-thru-the-web-of-redirects-2021-02-12/ There are reports that your website is down. You pull up the login page without incident. What’s next? Monitoring is critical. How detailed is this? How frequently are you sampling? The resolution to any issue is only as good as the response to a paged alert. https://ronaldbradford.com/blog/wdiltw-aws-rds-proxy-2021-02-05/ Sat, 06 Feb 2021 03:26:56 +0000 https://ronaldbradford.com/blog/wdiltw-aws-rds-proxy-2021-02-05/ This week I was evaluating AWS RDS Proxy . If you are familiar with the Relational Database Service (RDS) and use MySQL or Postgres, this is an additional option to consider. https://ronaldbradford.com/blog/enforcing-a-least-privileged-security-model-can-be-hard-2020-09-12/ Sat, 12 Sep 2020 22:01:52 +0000 https://ronaldbradford.com/blog/enforcing-a-least-privileged-security-model-can-be-hard-2020-09-12/ In a greenfield environment you generally have the luxury to right any wrongs of any past tech debt. It can be more difficult to apply this to an existing environment? For example, my setup is configured to just work with the AWS CLI and various litmus tests to validate that. https://ronaldbradford.com/blog/defensive-data-techniques-2020-08-02/ Sun, 02 Aug 2020 19:45:03 +0000 https://ronaldbradford.com/blog/defensive-data-techniques-2020-08-02/ As a data architect I always ensure that for any database schema change there a fully recoverable execution path. I have generally advised to create a patch/revert process for every change. https://ronaldbradford.com/blog/aws-cost-saving-tips-ebs-volumes-2015-03-10/ Tue, 10 Mar 2015 15:25:15 +0000 https://ronaldbradford.com/blog/aws-cost-saving-tips-ebs-volumes-2015-03-10/ A trivial cost saving tip for checking if you are spending money in your AWS environment on unused resources. This is especially appropriate when using provisioned IOPS EBS volumes. $ ec2-describe-volumes | grep available VOLUME vol-44dff904 8 snap-d86d0884 us-east-1b available 2014-08-01T14:11:24+0000 standard VOLUME vol-62dff922 100 us-east-1b available 2014-08-01T14:11:24+0000 io1 1000 VOLUME vol-15dff955 8 snap-d86d0884 us-east-1b available 2014-08-01T14:11:24+0000 standard VOLUME vol-80a88ec0 8 snap-d86d0884 us-east-1b available 2014-08-01T15:12:54+0000 standard VOLUME vol-ca82a48a 100 us-east-1b available 2014-08-01T16:13:49+0000 standard VOLUME vol-5d79581d 8 snap-d86d0884 us-east-1b available 2014-08-01T18:27:01+0000 standard VOLUME vol-baf9dbfa 8 snap-d86d0884 us-east-1b available 2014-08-03T18:20:59+0000 standard VOLUME vol-53ffdd13 8 snap-d86d0884 us-east-1b available 2014-08-03T18:25:52+0000 standard VOLUME vol-ade7daed 8 snap-d86d0884 us-east-1b available 2014-08-13T20:10:46+0000 standard VOLUME vol-34e2df74 8 snap-065a2e52 us-east-1b available 2014-08-13T20:26:17+0000 standard VOLUME vol-cacef38a 100 snap-280ffb7f us-east-1b available 2014-08-13T21:19:18+0000 standard VOLUME vol-41350a01 8 snap-f23ccba5 us-east-1b available 2014-08-14T16:54:27+0000 standard VOLUME vol-51350a11 100 snap-fc3ccbab us-east-1b available 2014-08-14T16:54:27+0000 standard VOLUME vol-912f10d1 8 snap-96ee24c1 us-east-1b available 2014-08-14T17:15:06+0000 standard VOLUME vol-a82f10e8 100 snap-9dee24ca us-east-1b available 2014-08-14T17:15:06+0000 standard These are available and unused EBS volumes which you should consider deleting. https://ronaldbradford.com/blog/another-reason-to-avoid-rds-2011-05-25/ Wed, 25 May 2011 15:33:48 +0000 https://ronaldbradford.com/blog/another-reason-to-avoid-rds-2011-05-25/ My list of reasons for never using or recommending Amazon’s MySQL RDS service grows every time I experience problems with customers. This was an interesting and still unresolved issue. ERROR 126 (HY000): Incorrect key file for table '/rdsdbdata/tmp/#sql_5b7_1. https://ronaldbradford.com/blog/basic-scalability-principles-to-avert-downtime-2011-04-23/ Sat, 23 Apr 2011 18:39:56 +0000 https://ronaldbradford.com/blog/basic-scalability-principles-to-avert-downtime-2011-04-23/ In the press in the last two days has been the reported outage of Amazon Web Services Elastic Compute Cloud (EC2) in just one North Virginia data center. This has affected many large website includes FourSquare , Hootsuite , Reddit and Quora . https://ronaldbradford.com/blog/problems-compiling-mysql-54-2009-06-11/ Thu, 11 Jun 2009 16:54:04 +0000 https://ronaldbradford.com/blog/problems-compiling-mysql-54-2009-06-11/ Seem’s the year Sun had for improving MySQL , and with an entire new 5.4 branch the development team could not fix the autoconf and compile dependencies that has been in MySQL for all the years I’ve been compiling MySQL. https://ronaldbradford.com/blog/setting-up-mysql-on-amazon-web-services-aws-presentation-2009-04-22/ Wed, 22 Apr 2009 16:28:25 +0000 https://ronaldbradford.com/blog/setting-up-mysql-on-amazon-web-services-aws-presentation-2009-04-22/ On Tuesday at the MySQL Camp 2009 in Santa Clara I presented Setting up MySQL on Amazon Web Services (AWS). This presentation assumed you know nothing about AWS, and have no account.