Re: [Rdo-list] [Softwarefactory-dev] Gitnetics integration, or how can we automate upstream changes polling
by Fabien Boucher
Hi Gabriele,
I add rdo-list as CC to that mail as the discussion is around
RPM Factory and Gitnetics. This may interest the RDO community.
For the context as the discussion started in the softwarefactory-dev ML:
https://www.redhat.com/archives/softwarefactory-dev/2016-February/msg0000...
Le 03/02/2016 11:44, Gabriele Cerami a écrit :
> On 03 Feb, Fabien Boucher wrote:
>>
>> So to summarize Gitnetic will help for such cases:
>> - we have a *-patches branch with some "not yet/never" included upstream changes
>> and where we want to cherry-pick upstream changes into it.
>> - we want to cherry-pick upstream changes into a "mirror" repository where we already
>> have included "not yet/never" included upstream changes.
>>
>> Gitnetic is then able to take actions when the cherry-pick is not possible, like
>> warning the maintainer via a notification like a Gerrit review, ...
>>
>> Let me know if I miss understood.
>
> Yes, gitnetics will try the cherry-pick and launch unit tests on the
> merged result. If the cherry pick is not possible, it will ask for human
> interaction in the form of comments on a gerrit review.
> It would also be able to include upstream changes into mirror
> repository on non -patches branches. This is not necessary for most of
> the upstream projects, because the master branches are tested by delorean, but
> delorean is not testing any local patch. It's the goal of rdo, offering
> packages from unpatched repositories, but it's not clear yet if for some
> opm repositories for example, we will be able to ship unpatched upstream
> releases.
For the case of the current stable RDO release "Liberty" there ~ 25 patches
in different projects like ironic, swift, horizon, opm, ... and patches
are applied on top of unmodified upstream project release AFAIK.
In RPM Factory patches are handled in form of Gerrit review (never merged) and
tox unit tests are run on each patches of the patches chain each time there is a
change in the chain. Ideally the use of a patches chain containing a patch
decreasing the upstream quality (the project no longer pass the unit test suite)
should be prohibited but at least a maintainer will know if the patch he's
including in the packaging is decreasing the quality.
Furthermore this is, I think, useful when a new minor release of an upstream
project is created, like a new tag in stable/liberty. In that case the maintainer
may want to reset the liberty-patches branch on that new tag then rebase the patches
chain and then the rebase will produce a new patchset and trigger a new run of unit test
for each patches of the chain.
About the master version of RDO, AFAIK yes Delorean does not use any patches when
trying to use rpm-master distgit to test the packaging against each upstream changes
so there is not need to run unit test in that case IMO.
About OPM, It seems there is an effort to split it and in that case I'm wondering why
eventual patches cannot be managed as explained above expect we replace
tox test by the right ones for Puppet.
>> Actually we have already imported all projects from rdoinfo (rdo.yml) into RPM factory.
>> This has been done by a tool called python-sfrdo. Let's take
>> an example: Nova:
>
> Yes, sorry, with "manual import" I meant that the mirror repository is
> maintained manually, I did not know about the periodic job. But then
> again nothing is testing local patches with new upstream changes, when
> the mirror is synchronized.
Yes at sync time changes coming from upstream are not tested because
this is a mirror so unit test has been already run on the upstream CI
(at least for OpenStack projects). And, at the moment a maintainer
rebase a patch or a chain of patches, unit test will then be run on each patches
of the chain.
After, in the case we want to sync be doing a cherry-pick of each upstream changes
on top of a modified version of a "mirror" repo/branch, yes I agree it is
safer to run unit test during the sync and I understand Gitnetics will
help in that way.
> We are yet not sure how much we want to test these upstream changes.
> Gitnetics tests even before merging...
>
>> We haven't yet thought to tightly integrate such options in the dashboard.
>> We first try to implement RPM Factory features in a separate tool
>> called python-sfrdo and evaluate after if there are generic enough to backport
>> them in Software Factory.
>
> Gitnetics is written in python too, and it uses yaml configuration file
> to handle all the various options for the projects it has to replicate.
>
>> But yes I think we can find a way to let a PTL/CORE member of a packaging
>> project to select the mechanism that will handle the sync of the "mirror" repo:
>>
>> Classical: like we have today in RPM Factory: Naive sync of master and stable/*
>> periodically.
>> Gitnetic: Classical is deactivated and Gitnetic managed the sync of branches
>> from upstream in a smarter manner taking in account "not yet/never" included upstream changes
>> has been inserted in the branches.
>
> Yes, something like this, maybe with more options (gitnetics
> configuration file contains branch mappings e.g. stable/kilo upstream is
> replicated downstream)
Alright do you think it possible to have such a workflow : ?
- Gitnetics is triggered on a slave by a periodic job to sync (by cherry-picking)
each "mirror" repositories (configured to be managed by Gitnetics).
- Each upstream changes are one by one cherry-picked on top of the liberty-patches
branch and triggering a unit test job attached to that project/branch (already
the case with RPM Factory). If unit test pass then the Gerrit review is merged.
- When a cherry-pick cannot apply a patch on top of the branch then Gitnetics create
the notification for warning the maintainer about the sync issue and let him take
an action
What do you think ?
Best regards
Fabien
> _______________________________________________
> Softwarefactory-dev mailing list
> Softwarefactory-dev(a)redhat.com
> https://www.redhat.com/mailman/listinfo/softwarefactory-dev
>
8 years, 10 months
[Rdo-list] Slow network performance on Kilo?
by Erich Weiler
Hi Y'all,
I've seen several folks on the net with this problem, but I'm still
flailing a bit as to what is really going on.
We are running RHEL 7 with RDO OpenStack Kilo.
We are setting this environment up still, not quite done yet. But in
our testing, we are experiencing very slow network performance when
downloading or uploading to and from VMs. We get like 300Kb/s or so.
We are using Neutron, MTU 9000 everywhere. I've tried disabling GSO,
LRO, TSO, GRO on the neutron interfaces, as well as the VM server
interfaces, still no improvement. I've tried lowing the VM MTU to 1500,
still no improvement. It's really strange. We do get connectivity, I
can ssh to the instances, but the network performance is just really,
really slow. It appears the instances can talk to each other very
quickly however. They just get slow network to the internet (i.e. when
packets go through the network node).
We are using VLAN tenant network isolation.
Can anyone point me in the right direction? I've been beating my head
against a wall and googling without avail for a week...
Many thanks,
erich
8 years, 10 months
[Rdo-list] RDO Meetups, week of February 8 2016
by Rich Bowen
The following are the meetups I'm aware of in the coming week where
OpenStack and/or RDO enthusiasts are likely to be present. If you know
of others, please let me know, and/or add them to
http://rdoproject.org/events
If there's a meetup in your area, please consider attending. If you
attend, please consider taking a few photos, and possibly even writing
up a brief summary of what was covered.
In particular, note that this Friday in Madrid is the 'MAD For
OpenStack' event, hosted by Alvaro Lopez Ortega!
--Rich
* Monday February 08 in Durham, NC, US: February Meetup: The State of
Trove - http://www.meetup.com/Triangle-OpenStack-Meetup/events/228260536/
* Tuesday February 09 in Dublin, IE: OpenStack Designate - DNS for your
OpenStack Cloud - http://www.meetup.com/OpenStack-Ireland/events/227453812/
* Tuesday February 09 in Istanbul, TR: Ankara 11. Meetup, Konu:
OpenStack ELK (Elastic Search, Logstash, Kibana) -
http://www.meetup.com/Turkey-OpenStack-Meetup/events/228575106/
* Wednesday February 10 in Iasi, RO: Openstack Workloads with Windows
Server 2016 - http://www.meetup.com/IS-DevOps-Meetup/events/228224839/
* Thursday February 11 in Tel Aviv-Yafo, IL: Orchestrating Kubernetes on
OpenStack, AWS and Azure -
http://www.meetup.com/OpenStack-Israel/events/228603910/
* Friday February 12 in Madrid, ES: OpenStack Mini-Conf -
http://www.meetup.com/MAD-for-OpenStack/events/227554166/
--
Rich Bowen - rbowen(a)redhat.com
OpenStack Community Liaison
http://rdoproject.org/
8 years, 10 months
[Rdo-list] ask.openstack.org unanswered questions - Feb 8 2016
by Rich Bowen
Many thanks to everyone that has helped get some of this list back under
two pages long. Here's this week's unanswered:
59 unanswered questions:
Magnum Bay create command fails with Error 400
https://ask.openstack.org/en/question/88065/magnum-bay-create-command-fai...
Tags: magnum, openstack, bay-create-fail
socket.error: [Errno 111] Connection refused
https://ask.openstack.org/en/question/87800/socketerror-errno-111-connect...
Tags: access, ovs-bridge, multi-tenant, liberty-neutron
connectivity chain diagnose
https://ask.openstack.org/en/question/87757/connectivity-chain-diagnose/
Tags: ovs, neutron, rdo, liberty
Create a new dashboard Error
https://ask.openstack.org/en/question/87549/create-a-new-dashboard-error/
Tags: dashboard, command, startdash, manage.py
OpenStack-Docker driver failed
https://ask.openstack.org/en/question/87243/openstack-docker-driver-failed/
Tags: docker, openstack, liberty
Clarification on docs for self service connectivity
https://ask.openstack.org/en/question/87183/clarification-on-docs-for-sel...
Tags: liberty, neutron, connectivity, router
Can't create volume with cinder
https://ask.openstack.org/en/question/86670/cant-create-volume-with-cinder/
Tags: cinder, glusterfs, nfs
error installing rdo kilo with proxy
https://ask.openstack.org/en/question/85703/error-installing-rdo-kilo-wit...
Tags: rdo, packstack, centos, proxy
Why is /usr/bin/openstack domain list ... hanging?
https://ask.openstack.org/en/question/85593/why-is-usrbinopenstack-domain...
Tags: puppet, keystone, kilo
[ RDO ] Could not find declared class ::remote::db
https://ask.openstack.org/en/question/84820/rdo-could-not-find-declared-c...
Tags: rdo
Sahara SSHException: Error reading SSH protocol banner
https://ask.openstack.org/en/question/84710/sahara-sshexception-error-rea...
Tags: sahara, icehouse, ssh, vanila
Error Sahara create cluster: 'Error attach volume to instance
https://ask.openstack.org/en/question/84651/error-sahara-create-cluster-e...
Tags: sahara, attach-volume, vanila, icehouse
Creating Sahara cluster: Error attach volume to instance
https://ask.openstack.org/en/question/84650/creating-sahara-cluster-error...
Tags: sahara, attach-volume, hadoop, icehouse, vanilla
Routing between two tenants
https://ask.openstack.org/en/question/84645/routing-between-two-tenants/
Tags: kilo, fuel, rdo, routing
Freeing IP from FLAT network setup
https://ask.openstack.org/en/question/84063/freeing-ip-from-flat-network-...
Tags: juno, existing-network, rdo, neutron, flat
How to deploy Virtual network function (VNF) in Opnstack integrated
Opendaylight
https://ask.openstack.org/en/question/84061/how-to-deploy-virtual-network...
Tags: vnf, kilo, opendaylight, nfv
RDO kilo installation metadata widget doesn't work
https://ask.openstack.org/en/question/83870/rdo-kilo-installation-metadat...
Tags: kilo, flavor, metadata
Not able to ssh into RDO Kilo instance
https://ask.openstack.org/en/question/83707/not-able-to-ssh-into-rdo-kilo...
Tags: rdo, instance-ssh
No able to create an instance in odl integrated RDO Kilo openstack
https://ask.openstack.org/en/question/83700/no-able-to-create-an-instance...
Tags: kilo, rdo, opendaylight, kilo-neutron, integration
redhat RDO enable access to swift via S3
https://ask.openstack.org/en/question/83607/redhat-rdo-enable-access-to-s...
Tags: swift, s3
openstack baremetal introspection internal server error
https://ask.openstack.org/en/question/82790/openstack-baremetal-introspec...
Tags: rdo, ironic-inspector, tripleo
glance\nova command line SSL failure
https://ask.openstack.org/en/question/82692/glancenova-command-line-ssl-f...
Tags: glance, kilo-openstack, ssl
Cannot create/update flavor metadata from horizon
https://ask.openstack.org/en/question/82477/cannot-createupdate-flavor-me...
Tags: rdo, kilo, flavor, metadata
Installing openstack using packstack (rdo) failed
https://ask.openstack.org/en/question/82473/installing-openstack-using-pa...
Tags: rdo, packstack, installation-error, keystone
can't start instances after upgrade/reboot
https://ask.openstack.org/en/question/82205/cant-start-instances-after-up...
Tags: cinder, iscsi, rdo, juno_rdo
Cinder LVM iSCSI can't attach
https://ask.openstack.org/en/question/82031/cinder-lvm-iscsi-cant-attach/
Tags: lvmiscsi, cinder, kilo, cento7, rdo
external "NFS"-Network for all vms
https://ask.openstack.org/en/question/81709/external-nfs-network-for-all-...
Tags: external-network, juno-neutron, ovs
RDO - Qrouters lose IP on public network
https://ask.openstack.org/en/question/80761/rdo-qrouters-lose-ip-on-publi...
Tags: rdo, juno_rdo, floating-ip, qrouter
Missing veth pair bond and wrong/superfluous physical interface?
https://ask.openstack.org/en/question/80556/missing-veth-pair-bond-and-wr...
Tags: rdo, kilo-neutron, neutron-openvswitch, brctl, packstack
VMware Host Backend causes No valid host was found. Bug ???
https://ask.openstack.org/en/question/79738/vmware-host-backend-causes-no...
Tags: vmware, rdo
--
Rich Bowen - rbowen(a)redhat.com
OpenStack Community Liaison
http://rdoproject.org/
8 years, 10 months
[Rdo-list] RDO Meetup at DevConf
by Rich Bowen
I don't expect that many of you at DevConfCZ are actively checking
email, but, just in case ...
we are still planning to hold the RDO Community Meetup, in room C228 (go
up the stairs behind the Red Hat table, turn left, follow the hallway
and the signs) at 15:00 today, immediately after Jakub's rdopkg talk.
There's a tentative agenda at
https://etherpad.openstack.org/p/rdo-devconfcz but we're also hoping
that questions and discussions will follow Jakub from his talk.
--
Rich Bowen - rbowen(a)redhat.com
OpenStack Community Liaison
http://rdoproject.org/
8 years, 10 months
[Rdo-list] Unanswered ask.openstack.org RDO questions
by Rich Bowen
I'm a few days behind this week, as I've been traveling. If you could
help out with the backlog of RDO questions on ask.openstack.org, it
would be hugely appreciated!
64 unanswered questions:
New Installation RDO sql problem
https://ask.openstack.org/en/question/88169/new-installation-rdo-sql-prob...
Tags: mariadb
Does activating DVR on RDO liberty require switching SELINUX on all
nodes to permissive state ?
https://ask.openstack.org/en/question/88155/does-activating-dvr-on-rdo-li...
Tags: rdo, liberty, dvr
RDO error ,please help me
https://ask.openstack.org/en/question/88151/rdo-error-please-help-me/
Tags: rdo, devsatck, install-openstack
glance configuration options in docs
https://ask.openstack.org/en/question/88125/glance-configuration-options-...
Tags: glance, configuration, documentation
Magnum Bay create command fails with Error 400
https://ask.openstack.org/en/question/88065/magnum-bay-create-command-fai...
Tags: magnum, openstack, bay-create-fail
socket.error: [Errno 111] Connection refused
https://ask.openstack.org/en/question/87800/socketerror-errno-111-connect...
Tags: access, ovs-bridge, multi-tenant, liberty-neutron
connectivity chain diagnose
https://ask.openstack.org/en/question/87757/connectivity-chain-diagnose/
Tags: ovs, neutron, rdo, liberty
Create a new dashboard Error
https://ask.openstack.org/en/question/87549/create-a-new-dashboard-error/
Tags: dashboard, command, startdash, manage.py
OpenStack-Docker driver failed
https://ask.openstack.org/en/question/87243/openstack-docker-driver-failed/
Tags: docker, openstack, liberty
Clarification on docs for self service connectivity
https://ask.openstack.org/en/question/87183/clarification-on-docs-for-sel...
Tags: liberty, neutron, connectivity, router
Can't create volume with cinder
https://ask.openstack.org/en/question/86670/cant-create-volume-with-cinder/
Tags: cinder, glusterfs, nfs
error installing rdo kilo with proxy
https://ask.openstack.org/en/question/85703/error-installing-rdo-kilo-wit...
Tags: rdo, packstack, centos, proxy
Why is /usr/bin/openstack domain list ... hanging?
https://ask.openstack.org/en/question/85593/why-is-usrbinopenstack-domain...
Tags: puppet, keystone, kilo
[ RDO ] Could not find declared class ::remote::db
https://ask.openstack.org/en/question/84820/rdo-could-not-find-declared-c...
Tags: rdo
Sahara SSHException: Error reading SSH protocol banner
https://ask.openstack.org/en/question/84710/sahara-sshexception-error-rea...
Tags: sahara, icehouse, ssh, vanila
Error Sahara create cluster: 'Error attach volume to instance
https://ask.openstack.org/en/question/84651/error-sahara-create-cluster-e...
Tags: sahara, attach-volume, vanila, icehouse
Creating Sahara cluster: Error attach volume to instance
https://ask.openstack.org/en/question/84650/creating-sahara-cluster-error...
Tags: sahara, attach-volume, hadoop, icehouse, vanilla
Routing between two tenants
https://ask.openstack.org/en/question/84645/routing-between-two-tenants/
Tags: kilo, fuel, rdo, routing
Freeing IP from FLAT network setup
https://ask.openstack.org/en/question/84063/freeing-ip-from-flat-network-...
Tags: juno, existing-network, rdo, neutron, flat
How to deploy Virtual network function (VNF) in Opnstack integrated
Opendaylight
https://ask.openstack.org/en/question/84061/how-to-deploy-virtual-network...
Tags: vnf, kilo, opendaylight, nfv
cann't install python-keystone-auth-token [Close Duplicate]
https://ask.openstack.org/en/question/83942/cannt-install-python-keystone...
Tags: python-keystone, openstack-swift
RDO kilo installation metadata widget doesn't work
https://ask.openstack.org/en/question/83870/rdo-kilo-installation-metadat...
Tags: kilo, flavor, metadata
Not able to ssh into RDO Kilo instance
https://ask.openstack.org/en/question/83707/not-able-to-ssh-into-rdo-kilo...
Tags: rdo, instance-ssh
No able to create an instance in odl integrated RDO Kilo openstack
https://ask.openstack.org/en/question/83700/no-able-to-create-an-instance...
Tags: kilo, rdo, opendaylight, kilo-neutron, integration
redhat RDO enable access to swift via S3
https://ask.openstack.org/en/question/83607/redhat-rdo-enable-access-to-s...
Tags: swift, s3
openstack baremetal introspection internal server error
https://ask.openstack.org/en/question/82790/openstack-baremetal-introspec...
Tags: rdo, ironic-inspector, tripleo
glance\nova command line SSL failure
https://ask.openstack.org/en/question/82692/glancenova-command-line-ssl-f...
Tags: glance, kilo-openstack, ssl
Cannot create/update flavor metadata from horizon
https://ask.openstack.org/en/question/82477/cannot-createupdate-flavor-me...
Tags: rdo, kilo, flavor, metadata
Installing openstack using packstack (rdo) failed
https://ask.openstack.org/en/question/82473/installing-openstack-using-pa...
Tags: rdo, packstack, installation-error, keystone
can't start instances after upgrade/reboot
https://ask.openstack.org/en/question/82205/cant-start-instances-after-up...
Tags: cinder, iscsi, rdo, juno_rdo
--
Rich Bowen - rbowen(a)redhat.com
OpenStack Community Liaison
http://rdoproject.org/
8 years, 10 months
[Rdo-list] What encourages good software design in openstack?
by Nick Yeates
I have been scouring Openstack artifacts to find examples of what encourages good software design in its system architecture and code. The info will be used in teaching university students. I suppose it would be good for new developers of the community too.
I found your blueprints and bugs and code reviews, but cant piece together how good architecture and design are encouraged via process and/or documents. Code standards? Design standards? I see the Design Summits, but have not yet found design recommendations or a process that new code goes through to ensure decent design rules of thumb.
Does it come from Developers experience, or are there some sort of artifacts to point at? I am not as interested in specific examples of good design (though please send me whatever), but more a meta of that. What encourages or describes good design in Openstack?
Thanks,
-Nick Yeates
8 years, 10 months