The band formed while Chippendale and Gibson attended the Rhode Island School of Design in Providence, Rhode Island, and Chippendale had heard about "a new kid who was a whiz on the bass guitar." The two formed Lightning Bolt, with Brian Chippendale on drums, Brian Gibson on bass guitar, and with Hisham Bharoocha on guitar and vocals joining the group after their first show. Bharoocha left the group in 1996 to continue with another RISD band that would eventually become Black Dice, and Chippendale took over vocal duties. The only officially released music with Bharoocha was a track on the Repopulation Program compilation. For the first few years, Lightning Bolt was primarily an improvisational band, touring the United States for months at a time and "just playing". The concept of writing songs and recording an album didn't occur to the band until 1997, when Ben McOsker, founder of Load Records, approached the duo.

During these formative years, Chippendale and his freshman-year college roommate Matt Brinkman began to set up Fort Thunder, a disused warehouse space in the Olneyville district of Providence. The space eventually came to house a number of local avant-garde artists and musicians, including Brian Ralph as well as Lightning Bolt.

In 2006, Lightning Bolt was deported from Japan days after they arrived to continue their tour from the UK. Band members were detained on arrival on the grounds that they did not have work permits. Their official appeal was rejected after 48 hours, and they were deported back to the United States.