Sweet sorrow was formed in fall of 1996 by Uros Kejzar (guitar), Aljosa Us (bass) and Sebastijan Pregelj (vocals). After a long search and multiple changes the band was joined by Mitja Radic (ex Weeping Willow) on drums. In March of 1997 the band entered a studio for the first time and recorded a demo tape for their own need (practice and developement) that contained five tracks.

Soon after that recording they began a search for a second guitarist and for a short time the band was joined by Helmut Franges. In summer 1997 singer Sebastijan and bass player Aljosa decided to find a new guitarist because Uros and Helmut showed a lack of interest due to their other interests in life. The band was preparing to start recording their debut album, with working title "12", in spring of 1997, but due to problems with guitarists the plan did not come to life until winter 1997/98. So instead of two existing guitarists band joined Ziga Hodnik (ex Helpless).

In winter 1997 the band joined by the new guitar force Ziga, signed the recording contract with studio "Gong" for their project still named "12". In November 1997 first recordings took place.

By this time Sweet Sorrow was joined by Ursa Kavsek who with her high and clear voice upgraded Sebastijan's singing and so added new dimensions to their music. February 1998 they completed first part (four songs) of the recording. During April Sweet Sorrow continued with the second part of their album, which was finished by the end of the year.
When the album was finished in November '98, the guys decided to call it Breaking The Silence instead of "12" as it was supposed to be entitled.

Soon after the recording was done, the band decided to continue without Ursa who asked to be only on the CD because she has no time for the band, but is prepared to join them on the next recording, which is already in sight. At the same time when the band lost Ursa they gained Pero Caric (ex Helpless, Scaffold) on the second guitar, giving them same depth of the music as it was recorded with only one guitar.

At the beginning of winter in 1999 the band parted ways with their long time drummer Mico because of the musical differences. Fortunately they found a replacement in a couple of days in Ales Berlot, who proved to be excelent drummer and a great replacement.

After a few concerts and songwriting with Ales on drums, the guys entered the Chinatown Studio on July 16th to record the second CD, that will probably be called "When Life And Death Are One". When the CD was done it was named "On Life and Death".
In spring 2002 the guys reentered the studio - this time to record a song for Slovenian metal compilation. The song recorded is entitled Do Pekla.

In summer 2002 they shot a video for the song Sanjam with Hans the Landlord and Klemen the Landlord jr. in main roles. In the end of 2002 Sebastijan, Ziga and Ales left the bend on friendly terms due to lack of time and interest.