Kafka has a great operations wiki, which provides some detail on how to operate Kafka at scale.

Auto-Create Topics

Kafka brokers should be configured to automatically create topics. Without this, it’s going to be very cumbersome to run Samze jobs, since jobs will write to arbitrary (and sometimes new) topics.