I just do
echo "export DYLD_FRAMEWORK_PATH=/Users/alex/Qt/5.11.1/clang_64/lib" > /Users/alex/.bash_profile
and everything magically starts working
edit: Actually it only worked temporarily since this only affects bash, for it to work completely you shall add this to ~/.MacOSX/environment.plist
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs$
<plist version="1.0">
<dict>
<key>DYLD_FRAMEWORK_PATH</key>
<string>/Users/alex/Qt/5.11.1/clang_64/lib</string>
</dict>
</plist>