Laravel with PHP Deployer on Minikube DB: Migrate Fails

[jasperf]

Running PHP Deployer on Minikube Kubernetes locally - see https://github.com/smart48/smt-demo - and getting

[192.168.64.24] > cd /tmp/hostpath-provisioner/smt-local/code/releases/1 && (setfacl -L -R -m u:"101":rwX -m u:`whoami`:rwX storage/app/public)
[192.168.64.24] > cd /tmp/hostpath-provisioner/smt-local/code/releases/1 && (setfacl -dL -R -m u:"101":rwX -m u:`whoami`:rwX storage/app/public)
• done on [192.168.64.24]
✔ Ok [906ms]
➤ Executing task artisan:storage:link
[192.168.64.24] > cd /tmp/hostpath-provisioner/smt-local/code/releases/1 && docker exec -t $(docker ps | grep smt-workspace | awk '{print $1}')  bash -c 'cd release | php' artisan --version
[192.168.64.24] > docker exec -t $(docker ps | grep smt-workspace | awk '{print $1}')  bash -c 'cd release | php' /tmp/hostpath-provisioner/smt-local/code/releases/1/artisan storage:link
• done on [192.168.64.24]
✔ Ok [466ms]
➤ Executing task artisan:view:cache
• done on [192.168.64.24]
✔ Ok [0ms]
➤ Executing task artisan:config:cache
[192.168.64.24] > docker exec -t $(docker ps | grep smt-workspace | awk '{print $1}')  bash -c 'cd release | php' /tmp/hostpath-provisioner/smt-local/code/releases/1/artisan config:cache
• done on [192.168.64.24]
✔ Ok [211ms]
➤ Executing task artisan:optimize
• done on [192.168.64.24]
✔ Ok [1ms]
➤ Executing task deploy:symlink
[192.168.64.24] > if [[ $(man mv 2>&1 || mv -h 2>&1 || mv --help 2>&1) =~ '--no-target-directory' ]]; then echo 'true'; fi
[192.168.64.24] < true
[192.168.64.24] > mv -T /tmp/hostpath-provisioner/smt-local/code/release /tmp/hostpath-provisioner/smt-local/code/current
• done on [192.168.64.24]
✔ Ok [81ms]
➤ Executing task db:migrate
[192.168.64.24] > cd /tmp/hostpath-provisioner/smt-local/code/releases/1 && php artisan migrate
[192.168.64.24] < bash: line 1: php: command not found
➤ Executing task deploy:failed
• done on [192.168.64.24]
✔ Ok [0ms]

In Client.php line 103:
                                                                                                       
  [Deployer\Exception\RuntimeException (127)]                                                          
  The command "cd /tmp/hostpath-provisioner/smt-local/code/releases/1 && php artisan migrate" failed.  
                                                                                                       
  Exit Code: 127 (Command not found)                                                                   
                                                                                                       
  Host Name: 192.168.64.24                                                                             
                                                                                                       
  ================                                                                                     
  bash: line 1: php: command not found                                                                 
                                                                                                       

Exception trace:
  at /Users/jasper/code/smt-demo/vendor/deployer/deployer/src/Ssh/Client.php:103
 Deployer\Ssh\Client->run() at /Users/jasper/code/smt-demo/vendor/deployer/deployer/src/functions.php:304
 Deployer\run() at /Users/jasper/code/smt-demo/deploy.php:39
 Deployer\Deployer::Deployer\{closure}() at n/a:n/a
 call_user_func() at /Users/jasper/code/smt-demo/vendor/deployer/deployer/src/Task/Task.php:105
 Deployer\Task\Task->run() at /Users/jasper/code/smt-demo/vendor/deployer/deployer/src/Executor/SeriesExecutor.php:60
 Deployer\Executor\SeriesExecutor->run() at /Users/jasper/code/smt-demo/vendor/deployer/deployer/src/Console/TaskCommand.php:144
 Deployer\Console\TaskCommand->execute() at /Users/jasper/code/smt-demo/vendor/symfony/console/Command/Command.php:255
 Symfony\Component\Console\Command\Command->run() at /Users/jasper/code/smt-demo/vendor/symfony/console/Application.php:971
 Symfony\Component\Console\Application->doRunCommand() at /Users/jasper/code/smt-demo/vendor/deployer/deployer/src/Console/Application.php:133
 Deployer\Console\Application->doRunCommand() at /Users/jasper/code/smt-demo/vendor/symfony/console/Application.php:290
 Symfony\Component\Console\Application->doRun() at /Users/jasper/code/smt-demo/vendor/symfony/console/Application.php:166
 Symfony\Component\Console\Application->run() at /Users/jasper/code/smt-demo/vendor/deployer/deployer/src/Deployer.php:326
 Deployer\Deployer::run() at /Users/jasper/.composer/vendor/deployer/deployer/bin/dep:137

deploy [-p|--parallel] [-l|--limit LIMIT] [--no-hooks] [--log LOG] [--roles ROLES] [--hosts HOSTS] [-o|--option OPTION] [--] [<stage>]

php artisan runs well except for php artisan migrate where command cannot be found for some reason:

The command "cd /tmp/hostpath-provisioner/smt-local/code/releases/1 && php artisan migrate" failed.  

Seems it does not use my adjusted path within the container. Or at least not properly.. Or it should in this case not run the Minikube Vm path but the container path...

Using this deploy.php now

<?php

namespace Deployer;

require 'recipe/laravel.php';
require 'vendor/deployer/recipes/recipe/cachetool.php';

// Configuration
set('repository', 'git@github.com:smart48/smt-demo.git');
set('default_stage', 'production');
set('git_tty', true); // [Optional] Allocate tty for git on first deployment
set('ssh_type', 'native');
set('cachetool', '/var/run/php/php7.4-fpm.sock');
// set('php_fpm_command', "kill -USR2 "$(ps -ef | grep '[p]hp-fpm: master' | awk '{print $2}')""); // for docker based setups with laradock or similar
set('keep_releases', 10);

// Make sure uploads & published , tls, logs aren't overwritten by deploying
set('shared_dirs', [
  'public/uploads',
  'public/published',
  'storage/logs',
  'storage/tls',
  'storage/app/public',
]);
set('shared_files', [
  '.env',
]);
set('writable_dirs', [
  'public/uploads',
  'public/published',
  'storage/framework/cache/data',
  'storage/logs',
  'storage/tls',
  'storage/app/public',
]);

// SMART CUSTOM DEPLOY COMMANDS
task('db:migrate', function () {
  run('cd {{release_path}} && php artisan migrate');
});
task('horizon:terminate', function () {
  run('cd {{release_path}} && php artisan horizon:terminate');
});

task('queue:restart', function () {
  run('cd {{release_path}} && php artisan queue:restart');
});

task('reload:php-fpm', function () {
  run('sudo /etc/init.d/php7.4-fpm restart'); // Using SysV Init scripts
  // run('{{php_fpm_command}}');
});


// Hosts
// local minikube host
// dep deploy 192.168.64.23
// `minikube ip` to get ip
// dep deploy production
// dep deploy staging


host('192.168.64.24')
  ->user('docker')
  ->identityFile('~/.minikube/machines/minikube/id_rsa')
  ->set('deploy_path', '/tmp/hostpath-provisioner/smt-local/code')
  // docker exec -it $(docker ps | grep smt-workspace | awk '{print $1}') /bin/bash
  ->set('bin/php', "docker exec -t $(docker ps | grep smt-workspace | awk '{print $1}')  bash -c 'cd release | php'")
  ->set('bin/composer', "docker exec -t $(docker ps | grep smt-workspace | awk '{print $1}') bash -c 'cd release && composer install'");

host('staging')
  ->hostname('staging.domain.com')
  ->user('forge')
  ->forwardAgent()
  ->stage('staging')
  ->set('deploy_path', '/home/forge/staging.domain.com');

host('production')
  ->hostname('domain.com')
  ->user('forge')
  ->forwardAgent()
  ->stage('production')
  ->set('deploy_path', '/home/forge/domain.com');


// Run database migrations
after('deploy:symlink', 'db:migrate');

// Restart job
after('db:migrate', 'queue:restart');

// Clear OPCache
after('queue:restart', 'cachetool:clear:opcache');
after('cachetool:clear:opcache', 'horizon:terminate');

after('deploy', 'reload:php-fpm');
after('rollback', 'reload:php-fpm');

Any ideas how I can get migrations to play nice as well?

Really far now and already have:

root@workspace-598b5ff496-nxz9k:/# cd code/
root@workspace-598b5ff496-nxz9k:/code# ll
total 20
drwxrwxrwx 5 root     root     4096 Dec 24 09:40 ./
drwxr-xr-x 1 root     root     4096 Dec 24 09:24 ../
lrwxrwxrwx 1 laradock laradock   10 Dec 24 09:39 current -> releases/1/
drwxr-xr-x 2 laradock laradock 4096 Dec 24 09:39 .dep/
drwxr-xr-x 3 laradock laradock 4096 Dec 24 09:39 releases/
drwxr-xr-x 4 laradock laradock 4096 Dec 24 09:40 shared/

and all including vendor file:

root@workspace-598b5ff496-nxz9k:/code/current# ll
total 924
drwxr-xr-x 16 laradock laradock   4096 Dec 24 09:40 ./
drwxr-xr-x  3 laradock laradock   4096 Dec 24 09:39 ../
drwxr-xr-x 13 laradock laradock   4096 Dec 24 09:39 app/
-rw-r--r--  1 laradock laradock   1686 Dec 24 09:39 artisan
drwxr-xr-x  3 laradock laradock   4096 Dec 24 09:39 bootstrap/
drwxr-xr-x  2 laradock laradock   4096 Dec 24 09:39 .circleci/
-rw-r--r--  1 laradock laradock   2033 Dec 24 09:39 composer.json
-rw-r--r--  1 laradock laradock 324682 Dec 24 09:39 composer.lock
drwxr-xr-x  2 laradock laradock   4096 Dec 24 09:39 config/
drwxr-xr-x  5 laradock laradock   4096 Dec 24 09:39 database/
-rw-r--r--  1 laradock laradock   2750 Dec 24 09:39 deploy.php
-rw-r--r--  1 laradock laradock    171 Dec 24 09:39 .dockerignore
-rw-r--r--  1 laradock laradock    220 Dec 24 09:39 .editorconfig
lrwxrwxrwx  1 laradock laradock     17 Dec 24 09:40 .env -> ../../shared/.env
-rw-r--r--  1 laradock laradock    777 Dec 24 09:39 .env.example
-rw-r--r--  1 laradock laradock    935 Dec 24 09:39 .env.smt.docker.example
-rw-r--r--  1 laradock laradock    944 Dec 24 09:39 .env.smt.example
drwxr-xr-x  9 laradock laradock   4096 Dec 24 09:39 .git/
-rw-r--r--  1 laradock laradock    111 Dec 24 09:39 .gitattributes
-rw-r--r--  1 laradock laradock    197 Dec 24 09:39 .gitignore
-rw-r--r--  1 laradock laradock    195 Dec 24 09:39 .gitmodules
-rw-r--r--  1 laradock laradock   1342 Dec 24 09:39 HISTORY.md
-rw-r--r--  1 laradock laradock   1192 Dec 24 09:39 package.json
-rw-r--r--  1 laradock laradock 463849 Dec 24 09:39 package-lock.json
-rw-r--r--  1 laradock laradock   1197 Dec 24 09:39 phpunit.xml
drwxr-xr-x 10 laradock laradock   4096 Dec 24 09:40 public/
-rw-r--r--  1 laradock laradock   4465 Dec 24 09:39 README.md
drwxr-xr-x  6 laradock laradock   4096 Dec 24 09:39 resources/
drwxr-xr-x  2 laradock laradock   4096 Dec 24 09:39 routes/
-rw-r--r--  1 laradock laradock    563 Dec 24 09:39 server.php
-rw-r--r--  1 laradock laradock   4438 Dec 24 09:39 SETUP.md
drwxr-xr-x 16 laradock laradock   4096 Dec 24 09:40 smt-docker/
drwxr-xr-x  3 laradock laradock   4096 Dec 24 09:40 smt-provision/
drwxr-xr-x  4 laradock laradock   4096 Dec 24 09:40 storage/
-rw-r--r--  1 laradock laradock    174 Dec 24 09:39 .styleci.yml
drwxr-xr-x  4 laradock laradock   4096 Dec 24 09:39 tests/
drwxr-xr-x 53 root     root       4096 Dec 24 09:40 vendor/
-rw-r--r--  1 laradock laradock    538 Dec 24 09:39 webpack.mix.js

Probably need to upgrade these command as well to run inside the container:

// SMART CUSTOM DEPLOY COMMANDS
task('db:migrate', function () {
  run('cd {{release_path}} && php artisan migrate');
});
task('horizon:terminate', function () {
  run('cd {{release_path}} && php artisan horizon:terminate');
});

task('queue:restart', function () {
  run('cd {{release_path}} && php artisan queue:restart');
});

Not sure yet how to do this well in the run commands.

[antonmedv]

Try to use {{bin/php}} and specify path to php correctly via set('bin/php', 'path to php bin');

[jasperf]

@antonmedv going to look into using {{bin/php}} and hard coded path as I had used at line ->set('bin/php', "docker exec -t $(docker ps | grep smt-workspace | awk '{print $1}') bash -c 'cd release | php'") for example.

Is it correct that {{bin/php}} will use my set PHP bin path with the line? Then I would however not need a path on top of it... Will need to test some more.

[jasperf]

These commands now work:

// SMART CUSTOM DEPLOY COMMANDS
// new `run('{{bin/php}} {{release_path}}/artisan migrate --force');`
// old `run('cd {{release_path}} && php artisan migrate');`
task('db:migrate', function () {
  run('{{bin/php}} {{release_path}}/artisan migrate --force');
});
task('horizon:terminate', function () {
  run('{{bin/php}} {{release_path}}/artisan horizon:terminate');
});

task('queue:restart', function () {
  run('{{bin/php}} {{release_path}}/artisan queue:restart');
});

now stuck at :

In Client.php line 103:
                                                                                                                             
  The command "cd /tmp/hostpath-provisioner/smt-local/code/releases/2 && (curl -sO https://gordalina.github.io/cachetool/downloads/-r: line 0: cd: release: No such file or directory)" failed.                                                       
                                                                                                                             
  Exit Code: 6 (Unknown error)                                                                                               
                                                                                                                             
  Host Name: 192.168.64.25                                                                                                   
                                                                                                                             
  ================                                                                                                           
  <html>                                                                                                                     
  <head><title>404 Not Found</title></head>                                                                                  
  <body>                                                                                                                     
  <center><h1>404 Not Found</h1></center>                                                                                    
  <hr><center>nginx</center>                                                                                                 
  </body>                                                                                                                    
  </html>                                                                                                                                                                                                                                            

Again No such file or directory..

Think that is a separate and older recipe used in a different location these days. Need to see how I can remedy this and then the reloading of php fpm and then I should be good to go for Minikube.

[jasperf]

Wonder how I could use vendor/deployer/recipes/recipe/cachetool.php required in current deploy.php with

require 'vendor/deployer/recipes/recipe/cachetool.php';

in the new setup @antonmedv . It is loaded differently with recipes differently set up now is it not?

[jasperf]

Read at an old thread of mine #2200 that you can use require 'contrib/cachetool.php'; in Deployer version 7. We are using v6.8.0. Is Deployer 7 stable enough now and will old deploy scripts still work @antonmedv ?

[antonmedv]

Bera 13 stable enough. No big changes will be added, only some docs.