NYC Just Forced Companies to Admit They’re Spying on You to Set Prices

Online shoppers face mandatory warnings when AI uses personal data to set prices under new state law

Annemarije de Boer Avatar
Annemarije de Boer Avatar

By

Our editorial process is built on human expertise, ensuring that every article is reliable and trustworthy. AI helps us shape our content to be as accurate and engaging as possible.
Learn more about our commitment to integrity in our Code of Ethics.

Image credit: Wikimedia

Key Takeaways

Key Takeaways

  • New York mandates stark warnings on AI-driven personalized pricing starting November 10
  • Algorithms analyze ZIP codes and browsing habits to charge different customers varying prices
  • Federal judge rejected retailer challenges, calling algorithmic pricing disclosures factually accurate

You’re booking a hotel room for next weekend when something catches your eye: “THIS PRICE WAS SET BY AN ALGORITHM USING YOUR PERSONAL DATA.” Not exactly the warm welcome most travel sites prefer. But this stark warning is now mandatory across New York, thanks to the Algorithmic Pricing Disclosure Act that took effect November 10. Every business using algorithms to set personalized prices must display this exact language—no euphemisms, no fine print. Attorney General Letitia James isn’t messing around: violate the rule, pay $1,000 per incident.

Your Data Drives the Price Machine

Modern pricing algorithms make early internet price discrimination look quaint.

Remember when Orbitz got busted steering Mac users toward pricier hotels? That was algorithmic pricing with training wheels. Today’s systems devour everything: your ZIP code, browsing history, device type, even how you scroll through pages. Target shoppers have discovered prices mysteriously increase when they browse the website while standing inside an actual Target store. Hotels charge 15-30% more when bookings come from wealthy neighborhoods—a concrete example of how your address becomes a pricing factor.

These aren’t glitches—they’re features of machine learning models trained on millions of transactions to predict exactly what you’ll paying too much. The sophistication leap from crude demographic assumptions to real-time behavioral analysis represents a fundamental shift in how commerce operates.

Business Groups Lost Their Court Challenge

Federal judge ruled algorithmic pricing disclosures are factual, not misleading.

The National Retail Federation fought hard to kill this law, arguing the disclosure was “ominous” and violated free speech rights. They claimed it unfairly demonized beneficial practices like targeted discounts. Federal Judge Jed S. Rakoff disagreed completely, ruling in October that the warning is “uncontroversial” and factually accurate.

The judge’s decision creates a clear precedent: retailers cannot hide behind constitutional arguments when consumers deserve transparency about data-driven pricing practices. His ruling essentially told businesses that if displaying this warning feels problematic, perhaps the underlying practice deserves scrutiny.

The New Shopping Reality Spreads

Uber complies while other states prepare similar legislation.

Uber now displays New York’s warning to riders, showing how major platforms are adapting to the new requirements. The company claims it only considers location and demand—not personal data—when setting fares, though that distinction might matter less as ten other states advance similar bills. California is eyeing its own restrictions, which would send shockwaves through Silicon Valley’s data-driven pricing industry.

Consumer advocates wanted an outright ban on algorithmic pricing discrimination. They got transparency instead. Whether that’s enough remains the million-dollar question as AI-powered commerce spreads nationwide, with New York’s model potentially serving as a template for broader regulatory action.

Share this

At Gadget Review, our guides, reviews, and news are driven by thorough human expertise and use our Trust Rating system and the True Score. AI assists in refining our editorial process, ensuring that every article is engaging, clear and succinct. See how we write our content here →