Can't deploy erp5
1 - 20 of 25 records - 0 items selected
  Summary
Can't deploy erp5 by Unknown User at 2019/12/13

We tryng to install https://www.erp5.com/deploy in our company, but no succeded. We have ubuntu 

Distributor ID: Ubuntu
Description:    Ubuntu 16.04.6 LTS
Release:        16.04
Codename:       xenial
 

At the 1st step we got the same https://www.erp5.com/forum/ERP5-wont-install-on-a-Linux-VM-FbAx5kNAac error ( u'ffff:ffff:ffff:ffff::/64' is not a valid IPv6 address string! ) . But is was gone with ubuntu upgrade. New we got the following error:

Traceback (most recent call last):
  File "/opt/slapos/eggs/slapos.core-1.5.4-py2.7.egg/slapos/grid/slapgrid.py", line 1335, in processComputerPartitionList
    self.processComputerPartition(computer_partition)
  File "/opt/slapos/eggs/slapos.core-1.5.4-py2.7.egg/slapos/grid/slapgrid.py", line 1226, in processComputerPartition
    raise e
IOError: Software Release https://lab.node.vifib.com/nexedi/slapos/raw/1.0.112/software/erp5/software.cfg is not correctly installed.
Missing file: /opt/slapgrid/5b41896bce906eba84123c9581f4751d/instance.cfg
 

 

Is there software.cfg ok (I see fail message)?

 

[buildout]
extends =
  ../../stack/erp5/buildout.cfg
# Test Suite: ERP5-MASTER ran at 2019/06/20 17:16:16.546716 UTC
#             10 failures, 0 errors, 6038 total, status: FAIL
[erp5]
revision = 80994259537cc30d255d9230aabaf47dce621bf8

 

How we can fix this issue?

Additional info:

 

[2019-12-13 22:26:58,876] INFO     Installing erp5.
[2019-12-13 22:26:58,876] INFO     Warning: "branch" parameter with value "master" is ignored. Checking out to revision 80994259537cc30d255d9230aabaf47dce621bf8.
[2019-12-13 22:26:58,876] INFO     Cloning into '/opt/slapgrid/5b41896bce906eba84123c9581f4751d/parts/erp5'...
[2019-12-13 22:26:58,876] INFO     Checking out files:  17% (14910/83621)
....

.....

Checking out files:  88% (3310/3761)
fatal: not a git repository: ../.git/modules/doc-bt5
[2019-12-13 22:26:58,877] INFO     fatal: could not reset submodule index
[2019-12-13 22:26:58,877] INFO     While:
[2019-12-13 22:26:58,877] INFO       Installing erp5.
[2019-12-13 22:26:58,877] INFO     Error: Impossible to clone repository.

 

 

I think it was a network problem. If you try again, it should work.

From: Yusei Tahara

I think it was a network problem. If you try again, it should work.

 

I think it's related to https://github.com/Nexedi/erp5/commit/b5b16628d0753647b87b4b7ff6c72eb32c3b224f#diff-8903239df476d7401cf9e76af0252622  .

You remove submodule "doc-bt5", but installer don't know about it. 

 

From: Unknown User
From: Yusei Tahara

I think it was a network problem. If you try again, it should work.

 

I think it's related to https://github.com/Nexedi/erp5/commit/b5b16628d0753647b87b4b7ff6c72eb32c3b224f#diff-8903239df476d7401cf9e76af0252622  .

You remove submodule "doc-bt5", but installer don't know about it. 

 

Additional info:

/opt/slapos/log/slapos-node-software.log 

[2019-12-21 14:55:43,797] INFO     Warning: "branch" parameter with value "master" is ignored. Checking out to revision 80994259537cc30d255d9230aabaf47dce621bf8.

So, it clone https://lab.nexedi.com/nexedi/erp5/tree/80994259537cc30d255d9230aabaf47dce621bf8 revision , not master.

Issue:

Bulidout.cfg from installer:

[buildout]
extends = https://lab.node.vifib.com/nexedi/slapos/raw/1.0.112/software/erp5/software.cfg
shared-part-list =.
       /opt/slapgrid/read_only_shared
      /opt/slapgrid/shared

https://lab.node.vifib.com/nexedi/slapos/raw/1.0.112/software/erp5/software.cfg

 

[buildout]
extends =
  ../../stack/erp5/buildout.cfg



# Test Suite: ERP5-MASTER ran at 2019/06/20 17:16:16.546716 UTC
#             10 failures, 0 errors, 6038 total, status: FAIL

[erp5]
revision = 80994259537cc30d255d9230aabaf47dce621bf8

 

https://lab.node.vifib.com/nexedi/slapos/raw/1.0.112/stack/erp5/buildout.cfg

 

[erp5]
recipe = slapos.recipe.build:gitclone
repository = https://lab.nexedi.com/nexedi/erp5.git
branch = master

 

Docs:

https://pypi.org/project/slapos.recipe.build/#revision-branch-priority

If both revision and branch parameters are set, revision parameters is used and branch parameter is ignored:

 

as thre result installer trying ro install 80994259537cc30d255d9230aabaf47dce621bf8 revision.

 

/opt/slapos.playbook/erp5-standalone.yml

vars:
    software_release_url: https://lab.node.vifib.com/nexedi/slapos/raw/1.0.112/software/erp5/software.cfg

 

Is that correct version (1.0.112) of  a release?

From: Unknown User

/opt/slapos.playbook/erp5-standalone.yml

vars:
    software_release_url: https://lab.node.vifib.com/nexedi/slapos/raw/1.0.112/software/erp5/software.cfg

 

Is that correct version (1.0.112) of  a release?

 

ok, I replaced it to version 1.0.131

https://lab.node.vifib.com/nexedi/slapos/raw/1.0.131/software/apache-frontend/software.cfg installed successfully

https://lab.node.vifib.com/nexedi/slapos/raw/1.0.131/software/erp5/software.cfg dropped down with:

 

[2020-01-07 22:06:12,280] INFO     Installing switch-softwaretype.
[2020-01-07 22:06:12,280] INFO     switch-softwaretype: Invoking commandline : '/opt/slapgrid/a9ea97b080723c67a854fe0e957a1258/bin/buildout -U -c /srv/slapgrid/slappart2/buildout-switch-softwaretype.cfg'
[2020-01-07 22:06:12,280] INFO     While:
[2020-01-07 22:06:12,280] INFO       Installing.
[2020-01-07 22:06:12,280] INFO       Getting section switch-apache-softwaretype.
[2020-01-07 22:06:12,280] INFO       Initializing section switch-apache-softwaretype.
[2020-01-07 22:06:12,280] INFO       Getting option switch-apache-softwaretype:single-custom-personal.
[2020-01-07 22:06:12,280] INFO       Getting section dynamic-custom-personal-template-slave-list.
[2020-01-07 22:06:12,280] INFO       Initializing section dynamic-custom-personal-template-slave-list.
[2020-01-07 22:06:12,280] INFO     Error: Missing option: directory:promises
[2020-01-07 22:06:12,280] INFO     While:
[2020-01-07 22:06:12,281] INFO       Installing switch-softwaretype.
[2020-01-07 22:06:12,281] INFO
[2020-01-07 22:06:12,281] INFO     An internal error occurred due to a bug in either zc.buildout or in a
[2020-01-07 22:06:12,281] INFO     recipe being used:
 

Hi. I got new information.

I am sorry but latest version of ERP5 is currently not building.

Our build test of ERP5 into a Debian Stretch OS is currently failing :

You can track all our tests on this page:

https://stack.nexedi.com/test_status?fbclid=IwAR0tnOIWOPn3ksRLnQES06zBe5yYNBffK3c8FwB502BGn2VG1yFZr_5nCdw

We are now fixing the build test of ERP5 on Debian. Until it is fixed, ERP5 will not build.

Hi. I got new information.

I am sorry but latest version of ERP5 is currently not building.

Our build test of ERP5 into a Debian Stretch OS is currently failing :

You can track all our tests on this page:

https://stack.nexedi.com/test_status?fbclid=IwAR0tnOIWOPn3ksRLnQES06zBe5yYNBffK3c8FwB502BGn2VG1yFZr_5nCdw

We are now fixing the build test of ERP5 on Debian. Until it is fixed, ERP5 will not build.

 

Ok, I've got it, thanks for the info! It seems we will move to another erp system.

From: Unknown User

Hi. I got new information.

I am sorry but latest version of ERP5 is currently not building.

Our build test of ERP5 into a Debian Stretch OS is currently failing :

You can track all our tests on this page:

https://stack.nexedi.com/test_status?fbclid=IwAR0tnOIWOPn3ksRLnQES06zBe5yYNBffK3c8FwB502BGn2VG1yFZr_5nCdw

We are now fixing the build test of ERP5 on Debian. Until it is fixed, ERP5 will not build.

 

Ok, I've got it, thanks for the info! It seems we will move to another erp system.

1. Any estimate as to when ERP5 build will be functional again?
2. Will this functionality only be for Debian 9 (Stretch), or will it also include Debian 10 (Buster)?
3. What seems to be the root cause of these failures and are these failures equivalent in both Debian 9 and 10 (according to the logs, script output, file presence, and computer behavior from our own testing, it seems to be the *.ymls in the playbook)?
I can possibly help fix the build, more specifically, the Debian 10 build, since we are attempting to run ERP5 on a brand new server Running Debian 10.2.0, however I will need to know where to start looking if I do so. I will keep an eye out on this forum post for responses. All the best!

Hi,

I don't know why that installation script is broken. I will try to build erp5 on debian 10 without the installation script. I will let you know a result tomorrow. erp5 on debian 9 should be ok although the installation script maynot work on debian 9(I don't use that script).

I confirmed that the current ERP5 software release in master branch is buildable on debian 10. So, once the installation script is fixed, ERP5 will be installable on debian 10. It means that developers who know slapos can build erp5 on debian without installation script now.

 

Hello, I'm responsible for upgrading the installer so that it works on Debian 10.

 

Yesterday, I fixed the problem you had in apache: https://lab.nexedi.com/nexedi/slapos/commit/e018d9df44243cf35340db0b0d1b88eafaa2e0a3

 

Today, I released a new version and push it into the playbook so you can already try the new version (see my latests commits in the installer script: https://lab.nexedi.com/nexedi/slapos.package/commits/master)

 

 I'm currently building everything and pushing it into our software cache. Once this is done, the test should work again.

 

Sorry for the inconvenience, we started to port everything to Debian 10 quite lately.

 

 

From: Thomas Gambier

Hello, I'm responsible for upgrading the installer so that it works on Debian 10.

 

Yesterday, I fixed the problem you had in apache: https://lab.nexedi.com/nexedi/slapos/commit/e018d9df44243cf35340db0b0d1b88eafaa2e0a3

 

Today, I released a new version and push it into the playbook so you can already try the new version (see my latests commits in the installer script: https://lab.nexedi.com/nexedi/slapos.package/commits/master)

 

 I'm currently building everything and pushing it into our software cache. Once this is done, the test should work again.

 

Sorry for the inconvenience, we started to port everything to Debian 10 quite lately.

 

 

Thanks for the quick reply.

 

Funny you should mention Apache. According to a run I did on VirtualBox running Debain 9 about a week ago, the install script/playbook is responsible for installing Apache2 to provide the frontend to ERP5. I just ran the install script again yesterday around 3PM EST, but this time for the actual Debian 10.2.0 server we plan on using, and then ran the following today:
root@erp:~# systemctl status apache2

Unit apache2.service could not be found.

This means that the the install script never reaches the Apache installation instructions in the install script (which I believe to be somewhere in the playbook).

According to the slapos-node-software.log file (linked to mega due to size), the playbook does complete, but a quick search of the word error in gedit shows that the installation experiences several GCC errors, especially toward the beginning of when the build starts doing things in the background.

You did mention that you are able to install ERP5 manually by not using the script. Is there any instruction out there on how to do so? If not, I would find it beneficial to have one out there in-case the script breaks like this again, especially for new potential developers such as myself.

Although the server we are testing is meant to be used for a professional business, we are in no rush to get it up and running at the moment and are willing to lend it to be temporarily used as a testing platform for fixing the ERP5 installation on the Debian 10 distro of ERP5. The server is a brand new Dell PowerEdge T440 with 8GB RDIMM RAM and a Xeon 4210 Silver Processor. In addition, you’ll get the support of a Software Engineer as well as a Computer Engineer. We would like to help in any way we can as we see ERP5 as a way to help out other small businesses like our own looking to find an alternative ERP software that does what we need and isn’t ridiculously expensive.

I await your response and would like to know how we can help! Thank you!

From: Unknown User
From: Thomas Gambier

Hello, I'm responsible for upgrading the installer so that it works on Debian 10.

 

Yesterday, I fixed the problem you had in apache: https://lab.nexedi.com/nexedi/slapos/commit/e018d9df44243cf35340db0b0d1b88eafaa2e0a3

 

Today, I released a new version and push it into the playbook so you can already try the new version (see my latests commits in the installer script: https://lab.nexedi.com/nexedi/slapos.package/commits/master)

 

 I'm currently building everything and pushing it into our software cache. Once this is done, the test should work again.

 

Sorry for the inconvenience, we started to port everything to Debian 10 quite lately.

 

 

Thanks for the quick reply.

 

Funny you should mention Apache. According to a run I did on VirtualBox running Debain 9 about a week ago, the install script/playbook is responsible for installing Apache2 to provide the frontend to ERP5. I just ran the install script again yesterday around 3PM EST, but this time for the actual Debian 10.2.0 server we plan on using, and then ran the following today:
root@erp:~# systemctl status apache2

Unit apache2.service could not be found.

This means that the the install script never reaches the Apache installation instructions in the install script (which I believe to be somewhere in the playbook).

According to the slapos-node-software.log file (linked to mega due to size), the playbook does complete, but a quick search of the word error in gedit shows that the installation experiences several GCC errors, especially toward the beginning of when the build starts doing things in the background.

You did mention that you are able to install ERP5 manually by not using the script. Is there any instruction out there on how to do so? If not, I would find it beneficial to have one out there in-case the script breaks like this again, especially for new potential developers such as myself.

Although the server we are testing is meant to be used for a professional business, we are in no rush to get it up and running at the moment and are willing to lend it to be temporarily used as a testing platform for fixing the ERP5 installation on the Debian 10 distro of ERP5. The server is a brand new Dell PowerEdge T440 with 8GB RDIMM RAM and a Xeon 4210 Silver Processor. In addition, you’ll get the support of a Software Engineer as well as a Computer Engineer. We would like to help in any way we can as we see ERP5 as a way to help out other small businesses like our own looking to find an alternative ERP software that does what we need and isn’t ridiculously expensive.

I await your response and would like to know how we can help! Thank you!

Looking deeper into the Apache issue and into the logs, it looks possible that the ERP5 frontend is never installed/configured. I checked and only apache2-bin is installed on our machine (this installation seems to contain no cfg and no /var/www folder, only a binary located in /usr/sbin). I did a quick recursive search to see if I could find calls to either use or install apache and this is what I found. Based on this finding, it seems that python3 (which I a assume was installed by the original run of the script) does contain a json under libcloud that is supposed to install apache2, and then a handful of ansible modules that are supposed to check its installation.

I'm also using

tail -f /opt/slapos/log/*.log

to keep track of what is happening in the background. From what I can see, SlapOS is running, as are the partitions, as well as zope. This only leaves the ERP5/SlapOS network interface (aka the Frontend) that isn't active, which according to this instruction set, should be handled by Apache2.

Again, we are willing to help in any way we can, even if it is as simple as being guinea pigs for the script.

This is a rough quick instruction of how to setup a standalone erp5 without installation script. (https://slapos.nexedi.com/ for more details)

First, your machine needs ipv6 internet connection. Then

apt-get install gnupg
wget -O- "https://download.opensuse.org/repositories/home:/VIFIBnexedi/Debian_10/Release.key" | apt-key add -

apt-get install slapos-node git

export PATH=$PATH:/sbin

slapos configure local (setup slapos node as standalone, it means that this node does not become a part of slapos cloud,
instead it uses a local dummy slapos master node, slapproxy)
)

slapos node format --now (It takes some minutes)

git clone https://lab.nexedi.com/nexedi/slapos.git

slapos supply /YOUR-SLAPOS-REPOSITORY-PATH/slapos/software/erp5/software.cfg local_computer
(local_computer is your node name, look at /etc/opt/slapos/slapos.cfg)

tail -f /opt/slapos/log/slapos-node-software.log (It takes several hours to build ERP5)
(`slapos node software` is executed by cron /etc/cron.d/slapos-node)
/opt/slapgrid/XXXX/.complete is a mark of complete.

prepare a request script like this:

import json
software_url = '/home/a/slapos/software/erp5/software.cfg'
parameter_dict = {}

request(software_url,
  'my_test_erp5',
  filter_kw={
    'computer_guid': 'local_computer',
  },
  software_type='default',
  partition_parameter_kw = {
    '_': json.dumps(parameter_dict, indent=2)
  }
)

slapos console < request.py

Let's wait for soem minutes. ERP5 cluster is setup automatically.
(`slapos node instance` is executed by cron /etc/cron.d/slapos-node)

Once setup is done, then,

slapos node

you will find something like this:

slappart0:bootstrap-monitor                                                 EXITED    Jan 31 10:31 AM
slappart0:caucased-on-watch                                                 RUNNING   pid 1134, uptime 0:00:07
slappart0:certificate_authority-1a4cd56cd8e659d9137c7bbd3db35a4e-on-watch   RUNNING   pid 1133, uptime 0:00:07
slappart0:crond-1a4cd56cd8e659d9137c7bbd3db35a4e-on-watch                   RUNNING   pid 1130, uptime 0:00:07
slappart0:monitor-httpd-1a4cd56cd8e659d9137c7bbd3db35a4e-on-watch           RUNNING   pid 1131, uptime 0:00:07
slappart0:monitor-httpd-graceful                                            EXITED    Jan 31 10:31 AM
slappart1:bootstrap-monitor                                                 EXITED    Jan 31 10:31 AM
slappart1:certificate_authority-1a4cd56cd8e659d9137c7bbd3db35a4e            RUNNING   pid 1138, uptime 0:00:07
slappart1:crond-1a4cd56cd8e659d9137c7bbd3db35a4e-on-watch                   RUNNING   pid 1141, uptime 0:00:07
...
slappart6:apache                                                            RUNNING   pid 1094, uptime 0:00:07
...

then, check your apache conf. In my case, it was in slappart6.

less /srv/slapgrid/slappart6/etc/apache/apache.conf

You will find which IP and port apache is listening. Apache uses internal IP,
thus it is not accessble from outside. You need to setup your own frontend web server to publish
slapos's apache. You should not change slapos apache conf by hand because it is overwritten by
"slapos node instance".

Once you can access to your erp5 instance, check your zope password.

less /opt/slapos/slapproxy.db (find inituser-password)

https://YOURERP5/erp5/ (use zope password to login)

 

 

if you do not have ipv6, look at https://lab.nexedi.com/yusei/a/blob/master/slapos.cfg (slapformat section)

input_definition_file = /etc/opt/slapos/computer_definition.cfg

https://lab.nexedi.com/yusei/a/blob/master/computer_definition.cfg

I don't use this option recently, but it should work.

From: Yusei Tahara

This is a rough quick instruction of how to setup a standalone erp5 without installation script. (https://slapos.nexedi.com/ for more details)

First, your machine needs ipv6 internet connection. Then

apt-get install gnupg
wget -O- "https://download.opensuse.org/repositories/home:/VIFIBnexedi/Debian_10/Release.key" | apt-key add -

apt-get install slapos-node git

export PATH=$PATH:/sbin

slapos configure local (setup slapos node as standalone, it means that this node does not become a part of slapos cloud,
instead it uses a local dummy slapos master node, slapproxy)
)

slapos node format --now (It takes some minutes)

git clone https://lab.nexedi.com/nexedi/slapos.git

slapos supply /YOUR-SLAPOS-REPOSITORY-PATH/slapos/software/erp5/software.cfg local_computer
(local_computer is your node name, look at /etc/opt/slapos/slapos.cfg)

tail -f /opt/slapos/log/slapos-node-software.log (It takes several hours to build ERP5)
(`slapos node software` is executed by cron /etc/cron.d/slapos-node)
/opt/slapgrid/XXXX/.complete is a mark of complete.

prepare a request script like this:

import json
software_url = '/home/a/slapos/software/erp5/software.cfg'
parameter_dict = {}

request(software_url,
  'my_test_erp5',
  filter_kw={
    'computer_guid': 'local_computer',
  },
  software_type='default',
  partition_parameter_kw = {
    '_': json.dumps(parameter_dict, indent=2)
  }
)

slapos console < request.py

Let's wait for soem minutes. ERP5 cluster is setup automatically.
(`slapos node instance` is executed by cron /etc/cron.d/slapos-node)

Once setup is done, then,

slapos node

you will find something like this:

slappart0:bootstrap-monitor                                                 EXITED    Jan 31 10:31 AM
slappart0:caucased-on-watch                                                 RUNNING   pid 1134, uptime 0:00:07
slappart0:certificate_authority-1a4cd56cd8e659d9137c7bbd3db35a4e-on-watch   RUNNING   pid 1133, uptime 0:00:07
slappart0:crond-1a4cd56cd8e659d9137c7bbd3db35a4e-on-watch                   RUNNING   pid 1130, uptime 0:00:07
slappart0:monitor-httpd-1a4cd56cd8e659d9137c7bbd3db35a4e-on-watch           RUNNING   pid 1131, uptime 0:00:07
slappart0:monitor-httpd-graceful                                            EXITED    Jan 31 10:31 AM
slappart1:bootstrap-monitor                                                 EXITED    Jan 31 10:31 AM
slappart1:certificate_authority-1a4cd56cd8e659d9137c7bbd3db35a4e            RUNNING   pid 1138, uptime 0:00:07
slappart1:crond-1a4cd56cd8e659d9137c7bbd3db35a4e-on-watch                   RUNNING   pid 1141, uptime 0:00:07
...
slappart6:apache                                                            RUNNING   pid 1094, uptime 0:00:07
...

then, check your apache conf. In my case, it was in slappart6.

less /srv/slapgrid/slappart6/etc/apache/apache.conf

You will find which IP and port apache is listening. Apache uses internal IP,
thus it is not accessble from outside. You need to setup your own frontend web server to publish
slapos's apache. You should not change slapos apache conf by hand because it is overwritten by
"slapos node instance".

Once you can access to your erp5 instance, check your zope password.

less /opt/slapos/slapproxy.db (find inituser-password)

https://YOURERP5/erp5/ (use zope password to login)

 

 

Glad you posted those instructions. No wonder there's an install script. That being said, I would recomend that ERP5 post that somewhere so that if the script fails again, developers can use it as a reference to figure out exactly which step the installation failed.
It also helped me pinpoint the issue that the install script is currently having with Debian 10. Based on everything you guys have told me and what I've found: using yesterday's build, I found that ERP5, zope, SlapOS and the apache backend are all present ( I found the apache.conf in partition 11; I also verified that the zope password already exists). This means that either the bash script or playbook completely fails at setting up the "frontend webserver to publish slapos's apache". I can't clearly tell if the frontend setup is meant to be in the bash script or in the playbook, but based on a sweep of both, neither contains instructions for setting up an apache frontend, or any frontend at all.

I'm not sure I fully understand how to "publish slapos's apache" from existing backend to frontend (I've only ever programmed frontend-only apache websites), but I'm also willing to wait for the script fix if you guys think you can fix the frontend installation problem in a reasonable time. As stated before, we're willing to help test the install script for ERP5 until its functional on Debian 10.

Thanks again!

I'm not sure I fully understand how to "publish slapos's apache" from existing backend to frontend (I've only ever programmed frontend-only apache websites),

You need a web server that works as a reverse proxy. I don't know if the erp5 installation script provides a frontend because slapos frontend system requires a public IP adress that is not usually free(need some cost to maintain it).

Anyway, it is easy to setup apache manually for backend erp5, use apache mod rewrite and mod proxy. See examples below. It is enough for a try.

https://lab.nexedi.com/yusei/a/blob/master/setup.sh

https://lab.nexedi.com/yusei/a/blob/master/erp5apachefront.conf

https://zope.readthedocs.io/en/latest/zopebook/VirtualHosting.html