I have done basically the same project as you many times in my work and found that two woods, not of the same tree, always will react in some manner when mating them together in an inlay. Some one on the Forum mentioned that this project might suffer future movement due to this and he is SO right....but all is not lost...Have you ever done much laminating of woods and using different woods in the project? In the job of laminating you will always use a superior glue (epoxy?), clamp it up well and patiently wait for cure before unclamping. Inlay work needs similar gluing, clamping and patience I have found, because you are mating different woods of different content together into one beautiful piece. One major mistake is to wet the woods with stain before gluing up. Let everything be natural and dry; sand to fit; glue up and clean off glue; clamp and let cure; sand entire project and then do staining. Epoxy, if not starved out of the joints, will keep the pieces in place for the rest of our lives and if you skim coat the entire finished & stained project with gloss epoxy and finish with varnish of your choice it should be a piece for your grandchildren to fight over?
Hard to describe these things but I hope you get the idea and I am sure the piece you made can be touched up and made to please with some work because you seem to know about wood working. And if you built a boat or two you have come across many problems and licked them?
Bill, your piece looks great as is from your post and I think you will become an in-lay artist if you just keep at it. It can be frustrating but lots of fun.