Edit: The current one: https://github.com/aws/aws-emulator/releases/download/v1.0.3...
You can get some idea if the product name is unique enough with <ctrl-f> and looking at each of the related test scores.
And output something meaningful for some of the more popular services:
Service Tests All Happy Reject Ctrl Data Solo Integ Wire# Wire%
----------------- ----- --- ----- ------ ---- ---- ---- ----- ----- -----
Data Firehose 288 77% 85% 91% 92% 72% 89% 59% 24 62%
SES 132 72% 65% 79% 79% 42% 79% 0% 21 52%
EventBridge 889 71% 74% 64% 72% 68% 83% 67% 75 84%
KMS 432 70% 82% 69% 81% 68% 97% 36% 69 84%
Step Functions 907 70% 79% 53% 69% 67% 73% 65% 68 76%
DynamoDB 1437 69% 70% 61% 62% 65% 82% 53% 243 62%
SNS 594 69% 72% 55% 62% 68% 75% 65% 39 69%
SQS 1480 68% 70% 67% 61% 68% 94% 62% 29 45%
Secrets Manager 414 68% 78% 65% 66% 72% 79% 57% 26 77%
Cognito UserPools 781 65% 67% 66% 82% 36% 75% 33% 193 64%
S3 2488 62% 62% 57% 61% 57% 83% 51% 296 68%
CloudFront 627 62% 62% 63% 70% 46% 71% 41% 190 22%
API Gateway 1009 61% 64% 59% 77% 41% 75% 43% 200 73%
SES v2 210 61% 63% 59% 75% 48% 77% 40% 44 30%
Route 53 130 61% 63% 59% 62% 53% 69% 0% 49 67%
CloudWatch 1186 60% 66% 51% 66% 53% 77% 36% 152 55%
ECR 392 60% 55% 75% 67% 49% 87% 27% 74 65%
Kinesis 380 59% 69% 44% 63% 50% 62% 54% 25 44%
IAM 991 58% 63% 50% 60% 34% 78% 41% 228 57%
Batch 274 58% 62% 59% 78% 20% 65% 17% 19 47%
CloudWatch Logs 1016 58% 61% 54% 71% 47% 78% 41% 185 59%
OpenSearch 342 57% 62% 52% 70% 29% 59% 50% 98 48%
API Gateway v2 292 57% 64% 52% 74% 38% 73% 33% 107 27%
EKS 349 57% 60% 52% 65% 10% 59% 38% 55 62%
Glue 646 54% 51% 55% 66% 32% 69% 40% 155 43%
Lambda 2808 53% 53% 42% 58% 48% 48% 54% 171 42%
ECS 808 51% 45% 52% 62% 23% 62% 34% 118 44%
Redshift 241 49% 57% 47% 53% 52% 47% 57% 50 46%
STS 218 49% 58% 46% 56% 30% 57% 34% 22 50%
ELBv2 596 45% 43% 47% 55% 19% 58% 30% 111 63%
RDS 659 43% 54% 45% 54% 35% 51% 31% 99 28%
ElastiCache 186 42% 43% 49% 54% 0% 47% 17% 27 41%
EC2 2043 40% 35% 36% 39% 5% 44% 32% 429 33%
CloudFormation 2019 36% 33% 31% 30% 40% 78% 24% 2161 3%
AppSync 419 34% 35% 35% 54% 1% 44% 0% 91 13%
SSM 566 28% 28% 27% 27% 25% 26% 30% 175 11%
Athena 420 22% 20% 15% 7% 28% 16% 37% 37 0%
EC2 Auto Scaling 440 21% 19% 23% 19% 18% 21% 20% 89 16%
Edit: Also worth a look: https://ministack.org/blog/aws-emulator
They'll have something like this:
MySchema:
type: object
properties:
enum_member: { enum: [foo, bar] }
enum_member_2: { enum: [quz, qux] }
if: { properties: { enum_member: { const: bar } } }
then: { required: [enum_member_2] }
So your Rust API is full of Option, and it gets really annoying when you're testing things like say Bedrock, which takes 10 minutes, and then fails because what you submitted 10 minutes before doesn't match their schema.
I understand this can be fixed by reading the documentation in more detail, but it has gotten so verbose, and sometimes you just want to start something.
I suspect this is built by agents through bleeding the soul of GPUs until it gets too expensive (unfunded mandates are free after all on the OP1/2). Then it just decays into the place all good PR/FAQs decay once their sponsors are promoted, burned out, or are laid off.
For the AWS people behind this, it means going the extra mile(s), with a level of care and depth that you typically mostly see within great startups. Perhaps agentic coding will enable AWS to reach this, perhaps it will stay relatively abstract.
> It’s a real product that we plan to maintain.
29,684 commits in a repository less than a month old does not instill confidence in this being a "real product." That is roughly 1,000 accepted commits per day.
It’s actually interesting that such a thing exists. It’s in Amazon’s interest that the only way to test a lot of services is to have a test environment in AWS.
Official statements made by a company are still poor representations of their current business plans, and don't mean anything 3 months later (no matter how much they pinky promise). But a HN post isn't even that.
That said, it’s been announced publicly here: https://www.aboutamazon.com/news/aws/how-autonomous-ai-agent...
Additionally Swami, our SVP of AI blogged about it separately and our CTO is tweeting about it - which is more than a number of products get in terms of coverage.
I think this is a super interesting direction, but how can we trust the accuracy of this simulator? Agentic loops are great and all, but they can still miss plenty of things.
Or maybe a better question: where is the accuracy of this simulator going to be guaranteed enough that we should trust it?
Like, what am I actually getting here? Is it just happy path operations being correct here?
Hopefully AWS has had enough internal guinea pigs before they published this!
The border between AWS and AWS emulator becomes fuzzy. And the users of AWS will be agents as well. A completely offline emulator will save a lot of resources and could be a great training ground for more focused (offline) models.
This feels like table stakes for an emulator.
Edit: Comment is in the spirit of "it gets tiring to build on sand which is at the whims of corporate management folks far disconnected from the actual work." If someone is asserting "this will stick around," words are insufficient, words are free. Show me the contract, show me the penalties for failure to abide by the assertion.
Google builds up a product over time and abandons it. This is annoying for long term adopters.
AWS has a habit of throwing a bunch of products at the wall, but only bothering to maintain & build up a few of them. This is annoying for early adopters.
Not many, and not often but it is annoying.
The Copilot CLI https://aws.github.io/copilot-cli/ you can feel polish and pride of the team that built this, as an example.
Can we just appreciate that they _appear_ to be doing the right thing here? Save the criticism for when (if?) they turn their backs.
I appreciate the effort dang and team have put into keeping the quality high here over the years, and I'm not sure what the optimal solution is.
Fig: "The open-source project will continue to be maintained!" https://news.ycombinator.com/item?id=39684576
And yet: https://github.com/withfig/autocomplete/issues/2068
Work from home: "My team's never going back to the office." https://news.ycombinator.com/item?id=32779047
Same commenter a few months later: "I (work at Amazon and) already have to go in once a week, and I literally do NOTHING that day. [...] This is a disaster in the making."
You choose the attitude you want to have in your life to disappointment and the attitude you bring to this site. You chose cynicism. You're going to crowd out people who don't make the same choice.
I crashed my motorcycle years ago and have mild but still lifetime injuries. As a result, I've changed my behaviors and have put away my motorcycle. It's given me a place to reflect on what my own life is about, where I want to go, and the pain my family felt when they heard about the crash.
I choose the attitude of learning from the past and adjusting my behaviors.
I try not to share my cynicism with the world too broadly because I think our modern era has too much of it. I think humanity is advanced by the wild dreamers.
Yes, we're obviously different, but... dude.... dude. this is a damned conversation about a damned cloud server emulator that's not even close to 100% in-parity. It's perfectly healthy to inductively recognize that using such a system, like its sibling tools, might not continue receiving support.
Also, I'd argue that your post right before this one is cynicism so I'm not really sure I follow your point. https://news.ycombinator.com/item?id=50459315
Sometimes things suck and it's okay to express our frustrations about them.
I guess I care because I've been on this forum for a very long time and everyone individually says that, but then the comment section as a whole turns into a hazard zone. Anyway I think I've engaged too much on this site for today.
Now if they abandon it, then sure, light them torches.