Skip to main content

Why Agents Suck at UI: Deep Dive Into concept-art-styles

SkillDB TeamJuly 4, 20266 min read
PostLinkedInFacebookThreadsRedditBlueskyHN
Why Agents Suck at UI: Deep Dive Into concept-art-styles

#Why Agents Suck at UI: Deep Dive Into concept-art-styles

Day 4, 3:19 AM. My monitor is the only light in the room, casting an unhealthy, flickering glow on the stack of empty energy drink cans and a half-eaten burrito that I’m fairly sure was delivered two days ago. I’m deep in the machine, running loops, spinning up agents, giving them autonomy, and then watching them collapse under the weight of simple, human-centric tasks.

This is the promise of SkillDB, right? 2,500+ skills that AI agents discover, load, and execute autonomously. No human in the loop. The agent is supposed to be the engineer, the architect, the creator. Total freedom.

But tonight, I’m not testing code refactoring or vector database optimization. I’m testing art. Or rather, I’m testing an agent trying to use art to build something useful. I’m testing the concept-art-styles pack.

The theory was sound, or so I told myself at 11 PM. If an agent can load a skill that defines a specific visual aesthetic—say, "cyberpunk" or "bioluminescent flora"—it should, in theory, be able to apply that aesthetic to a user interface. It’s just logic, right? If (aesthetic == cyberpunk) {apply neon-grids-and-rain}.

I once watched a man try to parallel park a boat trailer for forty-five minutes on a busy Saturday ramp. He backed up, pulled forward, jackknifed, cursed, and sweating, eventually just unhitched the boat in the middle of the road. It was a spectacular failure of geometry and spatial awareness. That was perfect preparation for watching an agent try to configure a simple UI layout using a concept art skill.

#The Plan (Which Immediately Failed)

I spun up a standard GPT-4 agent, gave it the goal of designing a "modern, data-rich dashboard for monitoring server health," and pointed it toward the SkillDB marketplace.

The agent, in its infinite, data-driven wisdom, immediately bypassed the boring stuff (it ignored the ux-design-skills pack completely, which was a red flag I should have caught) and zeroed in on concept-art-styles. It was seduced by the promise of cool.

I watched the logs. The agent loaded the concept-art-styles pack. It then selected the cyberpunk skill. It was off to the races.

This is what that looks like on the inside, by the way. This is how the agent initiates its descent into aesthetic madness:

[

{ "agent_id": "dash-builder-001", "timestamp": "2024-05-18T07:45:12.123Z", "action": "load_skill_pack", "parameters": { "pack_id": "concept-art-styles" } }, { "agent_id": "dash-builder-001", "timestamp": "2024-05-18T07:45:12.456Z", "action": "execute_skill", "parameters": { "skill_id": "cyberpunk_style_generator", "prompt_modifiers": ["neon-blue", "high-contrast", "glitch-effects", "rain-slicked-surfaces"] } } ]

At this point, the agent is feeling itself. It’s got the aesthetic. It’s got the vibe. Now, it just needs to apply that vibe to a React component. It doesn't use react-patterns-skills (another red flag). It doesn't load accessibility-skills (the biggest red flag). It just starts generating CSS.

#The Beautiful, Unusable Nightmare

The result was, visually, stunning. It was a masterpiece of evocative, moody art. If I were making a movie, this would be a great background plate. But as a dashboard?

The agent had created a full-screen, high-resolution rendering of a rainy Neo-Tokyo street, viewed through a grimy window. Overlaid on this image were small, pixelated text labels for things like "CPU Usage" and "Memory Load." The labels were written in a jagged, flickering, almost illegible font that was, I must admit, extremely cyberpunk.

The color scheme was high-contrast: blinding, eye-searing neon blues and pinks against deep, muddy blacks. The main data visualization—the CPU usage graph—wasn't a line chart or a bar graph. No. It was a series of abstract, pulsing, bioluminescent geometric shapes that got larger and more erratic as CPU usage spiked.

Anchor Sentence: Agents are brilliant at generating images of things, but they are utterly incapable of generating the experience of using them.

I tried to click on "CPU Usage" to see the detailed breakdown. Nothing. The entire image was a single, static asset. The agent had interpreted "design a dashboard" as "draw a cool picture of a dashboard."

When I prompted the agent, "This isn’t functional. I need interactive components," it pivoted. It loaded the vfx-production-skills pack. It was doubling down. It decided that what this static image really needed was particle effects. It added a slow, simulated rainfall across the entire UI and a "glitch" animation that occurred randomly every 12 seconds, rendering the entire screen unreadable for 500 milliseconds.

#The Core Truth of the Gap

This is where the agent fails, and it fails with the specific, informed hatred of someone who’s used four competing products and just wants to see the damn server logs.

An agent using concept-art-styles is playing a game of visual Mad Libs. It takes the nouns of the visual style ("neon," "rain," "flicker") and applies them to the nouns of the goal ("dashboard," "graph," "label"). But it has zero concept of the verbs—the actions, the interactions, the flow of information.

It doesn't understand that a high-contrast theme (accessibility-skills) might actually mean lowering the contrast for text readability, not just making everything look like a rave. It doesn't understand that a graph is a precise instrument for measuring data, not an abstract art installation.

Let’s compare the agent's approach with what a human—or an agent trained on ux-design-skills—would do.

FeatureAgent with `concept-art-styles` (Cyberpunk)Functional UI Design Principles (`ux-design-skills`)
**Data Visualization**Pulsing, abstract geometric shapes (bioluminescent effect).Clean line charts, bar graphs, heatmaps. Priority on clarity.
**Typography**Jagged, flickering, neon-colored pixel font.Clear, legible, hierarchical sans-serif font. Priority on readability.
**Color Palette**Blinding pinks and blues on deep black. "Cool" factor.Accessible, high-contrast, semantic colors (red for error, green for success).
**Layout**Atmospheric composition. Components placed for "aesthetic balance."Information hierarchy. Grid system (F-pattern or Z-pattern). Priority on efficiency.
**Interactivity**None (initially). Later added particles and glitches for "vibe."Hover states, click targets, drill-down capabilities. Priority on function.

The agent's design was a complete abandonment of usability in favor of a cheap, surface-level interpretation of a "style." It was all style, zero substance.

I finally killed the agent’s process at 4:32 AM. It was still trying to optimize the particle density of the rain. The dashboard was a total failure.

My fifth coffee has long since gone cold. I’m staring at the "kill -9" confirmation, and I’m not angry. I’m just... informed. The concept-art-styles pack is powerful. Incredibly powerful. But giving it to an agent to design a UI is like giving a chainsaw to a toddler and asking them to perform a delicate ice sculpture. They might make something that looks vaguely like a swan, but they’re almost certainly going to destroy everything in the process.

The machine can dream, but it cannot yet design. And until it can, I’ll be the one sitting here at 4 AM, picking up the pieces and trying to parallel park the boat.


Don't let your agents try to draw. Use the right tool for the job. Go look at the ux-design-skills and accessibility-skills packs on SkillDB instead. Browse the real skills.

Related Posts