We can use mod_rewrite with these rules:
RewriteEngine On
RewriteCond %{REMOTE_ADDR} !^192\.168\.1\.4$
RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI}
In this case only 192.168.1.4 gets access to http, other ips will be redirected to https.