Silverlight applications are packaged as .xap files. Those files must be keep in your web application. The default directory that is used for that is the ClientBin folder.
So if you have silverlight applications associated to your web project their .xap files should go there.