If you are referring to this movie, it was originally developed as a movie, and was not based on a book. The story was by the director, Albert Hughes, and there is a lot of information online about the professor who invented a "prehistoric" language that was spoken by the human characters. The movie included subtitles to make the invented language comprehensible for movie viewers.
https://en.wikipedia.org/wiki/Alpha_(2018_film)
https://www.imdb.com/title/tt4244998/
I can't find any record that it was ever adapted or released in book form. The premise of the movie does not seem to lend itself to being adapted to a printed format. As far as I can see, you must be remembering a different book.
One possibility might beAlpha and Omega by Aaron Rosenberg. This is a novel based on a film.
https://www.ebay.com/sch/i.html?_nkw=Alpha+and+Omega+by+Aaron+Rosenberg
Message 2 of 5