So it only provides a command line interface, but not the notebook interface. Am I getting it right?

There is a Jupyter notebook interface for the Wolfram Language:

https://github.com/WolframResearch/WolframLanguageForJupyter

Additionally, many IDEs support Wolfram Language for syntax coloring, command completion, contextual help, etc.:

http://www.wolfram.com/developer/