Ebonite Runtime¶
Runtime module is responsible for code that runs inside containers.
Here are runtime abstractions:
Interface- an object with some exposed methods. Builtin implementation:ModelInterfacewhich is created dynamically withmodel_interface().InterfaceLoader- loadsInterfaceinstance. Builtin implementation:ModelLoaderServer- gets an instance ofInterfaceand exposes it’s methods via some protocol. Builtin implementations:FlaskServerandAIOHTTPServer- all expose methods as http POST endpoints.
Also, these helper functions are available:
run_model_server()- createModelInterfacefrom model and runs debugServer.