I let an AI app pick my kid's summer camp and the results were... not great

So there's this new 'family assistant' app called Harmony that uses AI to make decisions for you. I was swamped with work in April and thought, why not? I gave it our budget, my son's age, and said 'find a good day camp'. It picked one called 'Wilderness Explorers' that looked fine online. Got there Monday and it was a hardcore survivalist camp for teens, my 8 year old was handed a flint and steel. The AI had totally missed the age filter. I learned that these systems can fail in ways you don't expect, not with a big crash, but by quietly ignoring a crucial detail. It makes you wonder who's really checking these things before they give advice that affects real people. Has anyone else had an AI planner mess up something important for their family?

3 comments

3 Comments

miamitchell25d ago

That part about failing "not with a big crash, but by quietly ignoring a crucial detail" is so true. I read an article about a travel AI that booked a family on a flight with a 12 hour layover because it only looked at price and total trip time, not the actual stopover length. These systems are just pattern matching, they don't understand context like a human would. They miss the small stuff that makes a huge difference in real life. It's scary how much trust we're supposed to put in them for things that actually matter.

fisher.adam25d ago

Totally get that. I double check any automated booking myself after a bad hotel mix up last year. These tools are handy but you still need a human to spot the weird stuff.

drew_park25d ago

Yeah, it's like we're training ourselves to be the backup system for all this "smart" tech. My thermostat learned my schedule so well it tried to cook us when we stayed home sick. It's not just travel, it's everything now. These tools are great at the average case but totally fall apart the second something even slightly unusual happens. We end up doing more work checking their work than if we just did it ourselves half the time.