Zhytomyia is almost certainly the city, district, and parish of Zhitomir. I have found no Taubuwka in that region. There is a Dabowka further west in the Roszyszce district. "Near" is a relative term so you may want to consider it but use with caution. Another place, Dubowaya, is closer but seems less likely by pronunciation.
For a good explanation of contents and use of EWZ records, go to http://www.volhynia.com/
and browse down the right hand column where you will find 4 references to it. These files can include good detailed info including even pics of ancestors but as with many other kinds of records, some have minimal help.
A good place to search for Germans from Volhynia is http://www.sggee.org
and you can find extracted parish records for them at http://www.sggee.org/research/StPeteBirth.html
The bad news is that most Lutheran records currently stop around 1885 so your 1898 era will be difficult to search. If the family was Baptist, you will find virtually nothing for them. There are records in Zhitomir Archives which are currently being extracted and purchased by SGGEE but it will probably be at least a year before they can be made available.