Link a document to a document set

Do you want some other documents in your document set without uploading it???

1. Edit your document set content type 
2. Add a new content type "link to documents".

This would help you to add any number of document references in your Document Set by creating Document Links.