w2v query search by Adding Fixed Features With Word Embeddings

two inputs which share the same word embedding and I would like to see if it is possible to mix in fixed features which describe further the contexts of the example. The use case is a query and a returned title page as the word embeddings and the fixed features are things like the length of each, various similarity measures of each etc).