seasharp
/
anvil
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Local modifications to ClusterLabs/Anvil by Alteeve
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
1772 Commits
2 Branches
0 Tags
21 MiB
Tag: Branch: Tree: 462ec6d903
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '462ec6d903'
${ noResults }
anvil/Anvil/Tools/Network.pm

3172 lines
135 KiB
Raw Normal View History Unescape

* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
package Anvil::Tools::Network;
#
# This module contains methods used to deal with networking stuff.
#
use strict;
use warnings;
use Data::Dumper;
use Scalar::Util qw(weaken isweak);
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
use Net::Netmask;
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
our $VERSION = "3.0.0";
my $THIS_FILE = "Network.pm";
### Methods;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# bridge_info
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# check_internet
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# check_network
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# download
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# find_matches
* Got the 'anvil-provision-server' script to the point where it actually saves the new server job. * Created the new method Cluster->get_primary_host_uuid() that returns the 'host_uuid' of the primary node in the given cluster. This is useful for external programs to figure out which node is primary. Example is provisioning a new server being assigned to the active node. Also created ->is_primary() that is a similar test to see if the active node is the primary node or not. * Updated Cluster->parse_cib() and ->parse_crm_mon() to work on remote hosts. * Updated Database->get_hosts() to store the short host names. * Created Get->host_from_ip_address() that translates an IP address to a host_uuid and host_name, if it's an IP assigned currently to a known host. * Created Network->find_target_ip() that simplifies finding which IP address to use when the caller wants to connect to a target host. * Reworked the anvil-join-anvil to parse fence_arguments in a way that handles passwords with spaces in them. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
# find_target_ip
* Created Network->get_company_from_mac() that converts a MAC address to the company name that owns it. * Added recording the last-change order for network interfaces in System->generate_state_json() so that the most recently unplugged and plugged back in interfaces can be tracked. * Worked out a faster way to ping scan subnets with nmap in striker-scan-network. Dropped average scan time from 35 minutes to 4~5 minutes for a /16 subnet. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# get_company_from_mac
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# get_ips
# get_network
# is_local
* Fixed bugs around ScanCore->check_power() so that it now returns time on batteries and highest charge are returned properly. * Created Network->is_our_interface() which returns '1' if an interface is one managed by an Anvil!. Also updated scan-network to use this to determine when an interface alert should be a warning or notice level alert. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# is_our_interface
* Updated the RPM spec file to generate '/etc/anvil/type.X' files to directly indicate the machine type. Updated System->get_host_type() to check for these files directly, falling back to parsing the host name if they don't exist. * Created Database->get_hosts_info() (though it's not at all finished) that will write out a unified JSON file contain all data known about all hosts/Anvil! systems. This will be later used to create the WebUI parts. * Also created, but also not finished, Network->load_interfces() that will work sort of like ->load_ups, but include all interfaces regardless of if they have an IP or not. * Fixed a bug where the new bridge_interface_note parameter didn't exist in the Database->insert_or_update_bridge_interfaces() method. * Updated anvil-update-states() to only write out the JSON/XML files if it's running on a dashboard. For nodes and DR hosts, it just needs to update the database. * Created a new hook in anvil-daemon that will call tasks on a machine that is configured. * As per RHEL 8.1 release notes, changed the package 'dnf-utils' to 'yum-utils' in the packages to load for install target repos. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# load_interfces
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# load_ips
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# is_ip_in_network
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# ping
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# read_nmcli
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=pod
=encoding utf8
=head1 NAME
Anvil::Tools::Network
Provides all methods related to networking.
=head1 SYNOPSIS
use Anvil::Tools;
# Get a common object handle on all Anvil::Tools modules.
my $anvil = Anvil::Tools->new();
# Access to methods using '$anvil->Storage->X'.
#
=head1 METHODS
Methods in this module;
=cut
sub new
{
my $class = shift;
my $self = {
};
bless $self, $class;
return ($self);
}
# Get a handle on the Anvil::Tools object. I know that technically that is a sibling module, but it makes more
# sense in this case to think of it as a parent.
sub parent
{
my $self = shift;
my $parent = shift;
$self->{HANDLE}{TOOLS} = $parent if $parent;
# Defend against memory leads. See Scalar::Util'.
if (not isweak($self->{HANDLE}{TOOLS}))
{
weaken($self->{HANDLE}{TOOLS});
}
return ($self->{HANDLE}{TOOLS});
}
#############################################################################################################
# Public methods #
#############################################################################################################
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 bridge_info
This calls C<< bridge >> to get data on interfaces connected to bridges. A list of interfaces to connected to each bridge is stored here;
* bridge::<target>::<bridge_name>::interfaces = Array reference of interfaces connected this bridge
The rest of the variable / value pairs are stored here. See C<< man bridge -> state >> for more information of these values
* bridge::<target>::<bridge_name>::<interface_name>::<variable> = <value>
The common variables are;
* bridge::<target>::<bridge_name>::<interface_name>::ifindex = Interface index number.
* bridge::<target>::<bridge_name>::<interface_name>::flags = An array reference storing the flags set for the interface on the bridge.
* bridge::<target>::<bridge_name>::<interface_name>::mtu = The maximum transmitable unit size, in bytes.
* bridge::<target>::<bridge_name>::<interface_name>::state = The state of the bridge.
* bridge::<target>::<bridge_name>::<interface_name>::priority = The priority for this interface.
* bridge::<target>::<bridge_name>::<interface_name>::cost = The cost of this interface.
Paramters;
=head3 password (optional)
If C<< target >> is set, this is the password used to log into the remote system as the C<< remote_user >>. If it is not set, an attempt to connect without a password will be made (though this will usually fail).
=head3 port (optional, default 22)
If C<< target >> is set, this is the TCP port number used to connect to the remote machine.
=head3 remote_user (optional)
If C<< target >> is set, this is the user account that will be used when connecting to the remote system.
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head3 target (optional, default '')
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
If set, the bridge data will be read from the target machine. This needs to be the IP address or (resolvable) host name of the target.
=cut
sub bridge_info
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->bridge_info()" }});
my $password = defined $parameter->{password} ? $parameter->{password} : "";
my $port = defined $parameter->{port} ? $parameter->{port} : 22;
my $remote_user = defined $parameter->{remote_user} ? $parameter->{remote_user} : "root";
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $target = defined $parameter->{target} ? $parameter->{target} : "";
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
password => $anvil->Log->is_secure($password),
port => $port,
remote_user => $remote_user,
target => $target,
}});
my $shell_call = $anvil->data->{path}{exe}{bridge}." -json -pretty link show";
my $output = "";
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if ($anvil->Network->is_local({host => $target}))
{
# Local call.
($output, my $return_code) = $anvil->System->call({debug => $debug, shell_call => $shell_call});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:return_code' => $return_code,
}});
}
else
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Remote call
($output, my $error, my $return_code) = $anvil->Remote->call({
debug => $debug,
shell_call => $shell_call,
target => $target,
user => $remote_user,
password => $password,
remote_user => $remote_user,
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:error' => $error,
's3:return_code' => $return_code,
}});
}
# Did I get usable data?
if ($output !~ /^\[/)
{
# Bad data.
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0443", variables => { output => $output }});
return(1);
}
my $json = JSON->new->allow_nonref;
my $bridge_data = $json->decode($output);
foreach my $hash_ref (@{$bridge_data})
{
* Updated Database->resync_databases() to set a default schema of 'public'. Also fixed a bug where, when the difference in record numbers between two line was > 999, it would not trigger a resync. * Updated the scan agent timeout to 60 seconds. Also made the scan agent exit code log entries more helpful. * Updated System->collect_ipmi_data() to now better handle duplicate sensor names. Now, instead of simply appending an integer, we find the hex address and use that in the sensor name when duplicates exist. This solves the problem of the sensor names not being consistently shown in order. * Fixed message bugs (bad variable insertions) in scan-apc-pdu and scan-apc-ups. * Fixed schema procedure bugs in the 'temperature' and 'ip_address' tables where the columns were in bad order, causing constanty updates. Incomplete work; * Create the shell of 'anvil-manage-storage', but virtually no logic exists in it yet. * Started work on anvil-safe-start to deal with an issue where DRBD resources don't start when a server is running on a peer. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
next if not defined $hash_ref->{master};
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $bridge = $hash_ref->{master};
my $interface = $hash_ref->{ifname};
* Moved the '_host_name', '_short_host_name', and '_domain_name' private methods in Tools.pm over to Get.pm (removing the leading '_' in the method names). * Created 'Cluster->which_node' that returns 'node1' or 'node2' to indicate which node a host is. * Continued working on scan_cluster; decided to make it not host-dependent. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
my $host = $target ? $target : $anvil->Get->short_host_name();
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:bridge' => $bridge,
's2:interface' => $interface,
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
's3:host' => $host,
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if ((not exists $anvil->data->{bridge}{$host}{$bridge}) or (ref($anvil->data->{bridge}{$host}{$bridge}{interfaces}) ne "ARRAY"))
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{bridge}{$host}{$bridge}{interfaces} = [];
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->data->{bridge}{$host}{$bridge}{found} = 1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"bridge::${host}::${bridge}::interfaces" => $anvil->data->{bridge}{$host}{$bridge}{interfaces},
"bridge::${host}::${bridge}::found" => $anvil->data->{bridge}{$host}{$bridge}{found},
}});
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
push @{$anvil->data->{bridge}{$host}{$bridge}{interfaces}}, $interface;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# Now store the rest of the data.
foreach my $key (sort {$a cmp $b} keys %{$hash_ref})
{
next if $key eq "master";
next if $key eq "ifname";
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{bridge}{$host}{$bridge}{$interface}{$key} = $hash_ref->{$key};
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"bridge::${host}::${bridge}::${interface}::${key}" => $anvil->data->{bridge}{$host}{$bridge}{$interface}{$key},
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
}
}
return(0);
}
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
=head2 check_network
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
This method checks to see if bridges and the links in bonds are up. It can simply report the bridge, bond and link states, or it can try to bring up interfaces that are down.
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
Note: Continuing to resolve the build issues with network startup. Expect breakage. * Upped the aging of jobs and alerts data from 2 to 24 hours. Also added a check to prevent deleting a job of any age that is incomplete. * Major update to anvil-configure-host to not touch the network unless something has actually changed. Not yet tested on a fresh system, will verify nothing broke in the CI tests this commit will trigger. Also changed it so that, if after reconfiguring the network it times out trying to reconnect to a database, it calls a reboot instead of simply exiting. Further, a reboot is now not called on exit unless something changed to require it. * Updated Network->check_bonds() to return '1' if anything was done to heal a bond. * Updated anvil-update-states to be more careful about clearing virsh bridges. Specifically, it checks to see if virsh is running and that the returned bridges aren't actually error codes. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
This method returns C<< 0 >> if nothing was done. It returns C<< 1 >> if any repairs were done.
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
Data is stored in the hash;
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
* bridge_health::<bridge_name>::up = [0,1]
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
* bond_health::<bond_name>::up = [0,1]
* bond_health::<bond_name>::active_links = <number of interfaces active in the bond, but not necessarily up>
* bond_health::<bond_name>::up_links = <number of links that are 'up' or 'going back'>
* bond_health::<bond_name>::configured_links = <the number of interfaces configured to be members of this bond>
* bond_health::<bond_name>::interface::<interface_name>::in_bond = [0,1] <set to '1' if the interface is active in the bond>
* bond_health::<bond_name>::interface::<interface_name>::up = [0,1] <set to '1' if 'up' or 'going back'>
* bond_health::<bond_name>::interface::<interface_name>::carrier = [0,1] <set to '1' if carrier detected>
* bond_health::<bond_name>::interface::<interface_name>::name = <This is the NetworkManager name of the interface>
Parameters;
=head3 heal (optional, default 'down_only')
When set to C<< down_only >>, a bond where both links are down will attempt to up the links. However, bonds with at least one link up will be left alone. This is the default behaviour as it's not uncommon for admins to remotely down a single interface that is failing to stop alerts until a physical repair can be made.
When set to C<< all >>, any interfaces that are found to be down will attempt to brought up.
Wen set to C<< none >>, no attempts will be made to bring up any interfaces. The states will simply be recorded.
B<< Note >>: Interfaces that show no carrier will not be started in any case.
=cut
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
sub check_network
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->check_internet()" }});
* Finished Cluster->check_server_constraints() and added it to scan-cluster. This now makes sure servers don't roll back to their old host after it has been fenced and recovers. * Completely disabled Network->check_network(), it's causing more problems than it solves. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# This is causing more problems than it solves. Disabled for the time being.
return(0);
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my $heal = defined $parameter->{heal} ? $parameter->{heal} : "down_only";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
heal => $heal,
}});
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# Find out the bonds that are up.
my $host = $anvil->Get->short_host_name();
$anvil->Network->bridge_info({debug => $debug});
* Clear out the bond health in Network->check_network(). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
if (exists $anvil->data->{bond_health})
{
delete $anvil->data->{bond_health};
}
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# Read in the network configuration files to track which interfaces are bound to which bonds.
Note: Continuing to resolve the build issues with network startup. Expect breakage. * Upped the aging of jobs and alerts data from 2 to 24 hours. Also added a check to prevent deleting a job of any age that is incomplete. * Major update to anvil-configure-host to not touch the network unless something has actually changed. Not yet tested on a fresh system, will verify nothing broke in the CI tests this commit will trigger. Also changed it so that, if after reconfiguring the network it times out trying to reconnect to a database, it calls a reboot instead of simply exiting. Further, a reboot is now not called on exit unless something changed to require it. * Updated Network->check_bonds() to return '1' if anything was done to heal a bond. * Updated anvil-update-states to be more careful about clearing virsh bridges. Specifically, it checks to see if virsh is running and that the returned bridges aren't actually error codes. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my $repaired = 0;
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my $interface = "";
my $directory = $anvil->data->{path}{directories}{ifcfg};
local(*DIRECTORY);
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0018", variables => { directory => $directory }});
opendir(DIRECTORY, $directory);
while(my $file = readdir(DIRECTORY))
{
if ($file =~ /^ifcfg-(.*)$/)
{
$interface = $1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { interface => $interface }});
# We'll check these, so this just makes sure we don't get an undefined variable error.
$anvil->data->{raw_network}{interface}{$interface}{variable}{TYPE} = "";
$anvil->data->{raw_network}{interface}{$interface}{variable}{DEVICE} = "";
$anvil->data->{raw_network}{interface}{$interface}{variable}{MASTER} = "";
}
else
{
next;
}
my $full_path = $directory."/".$file;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { full_path => $full_path }});
my $device = "";
my $is_link = "";
my $in_bond = "";
my $is_bond = "";
# Read in the file.
my $file_body = $anvil->Storage->read_file({debug => ($debug+1), file => $full_path});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { file_body => $file_body }});
foreach my $line (split/\n/, $file_body)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
$line =~ s/#.*$//;
if ($line =~ /^(.*?)=(.*)$/)
{
my $variable = $1;
my $value = $2;
$value =~ s/^"(.*)"$/$1/;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
variable => $variable,
value => $value,
}});
$anvil->data->{raw_network}{interface}{$interface}{variable}{$variable} = $value;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"raw_network::interface::${interface}::variable::${variable}" => $anvil->data->{raw_network}{interface}{$interface}{variable}{$variable},
}});
}
}
$interface = "";
}
closedir(DIRECTORY);
# Process
foreach my $interface (sort {$a cmp $b} keys %{$anvil->data->{raw_network}{interface}})
{
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my $type = $anvil->data->{raw_network}{interface}{$interface}{variable}{TYPE};
my $device = $anvil->data->{raw_network}{interface}{$interface}{variable}{DEVICE};
my $name = defined $anvil->data->{raw_network}{interface}{$interface}{variable}{NAME} ? $anvil->data->{raw_network}{interface}{$interface}{variable}{NAME} : $device;
$name =~ s/ /_/g;
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
interface => $interface,
type => $type,
device => $device,
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
name => $name,
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
}});
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# Is this a bridge?
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
if (lc($type) eq "bridge")
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
{
# Yup!
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->data->{bridge_health}{$device}{up} = 0;
$anvil->data->{bridge_health}{$device}{name} = $name;
if ((exists $anvil->data->{bridge}{$host}{$device}) && ($anvil->data->{bridge}{$host}{$device}{found}))
{
$anvil->data->{bridge_health}{$device}{up} = 1;
}
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"bridge_health::${device}::up" => $anvil->data->{bridge_health}{$device}{up},
"bridge_health::${device}::name" => $anvil->data->{bridge_health}{$device}{name},
}});
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
}
# Is this a bond?
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
if (lc($type) eq "bond")
{
# Yes!
$anvil->data->{bond_health}{$device}{configured_links} = 0;
$anvil->data->{bond_health}{$device}{active_links} = 0;
$anvil->data->{bond_health}{$device}{up_links} = 0;
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->data->{bond_health}{$device}{name} = $name;
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# Find the links configured to be under this bond.
foreach my $this_interface (sort {$a cmp $b} keys %{$anvil->data->{raw_network}{interface}})
{
# Is this a bond?
my $this_type = $anvil->data->{raw_network}{interface}{$this_interface}{variable}{TYPE};
my $this_device = $anvil->data->{raw_network}{interface}{$this_interface}{variable}{DEVICE};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
this_interface => $this_interface,
this_type => $this_type,
this_device => $this_device,
}});
next if lc($this_type) ne "ethernet";
my $master = $anvil->data->{raw_network}{interface}{$this_interface}{variable}{MASTER};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { master => $master }});
if (($master) && ($master eq $device))
{
# This interface belongs to this bond.
$anvil->data->{bond_health}{$device}{interface}{$this_device}{in_bond} = 0;
$anvil->data->{bond_health}{$device}{interface}{$this_device}{up} = "unknown";
$anvil->data->{bond_health}{$device}{interface}{$this_device}{carrier} = "unknown";
$anvil->data->{bond_health}{$device}{interface}{$this_device}{name} = $this_interface;
$anvil->data->{bond_health}{$device}{configured_links}++;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"bond_health::${device}::interface::${this_device}::name" => $anvil->data->{bond_health}{$device}{interface}{$this_device}{name},
"bond_health::${device}::configured_links" => $anvil->data->{bond_health}{$device}{configured_links},
}});
# Read the interface's carrier
my $carrier_file = "/sys/class/net/".$this_device."/carrier";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { carrier_file => $carrier_file }});
if (-e $carrier_file)
{
my $carrier = $anvil->Storage->read_file({debug => ($debug+1), file => $carrier_file});
chomp $carrier;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { carrier => $carrier }});
$anvil->data->{bond_health}{$device}{interface}{$this_device}{carrier} = $carrier;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"bond_health::${device}::interface::${this_device}::carrier" => $anvil->data->{bond_health}{$device}{interface}{$this_device}{carrier},
}});
}
my $operstate_file = "/sys/class/net/".$this_device."/operstate";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { operstate_file => $operstate_file }});
if (-e $operstate_file)
{
my $operstate = $anvil->Storage->read_file({debug => ($debug+1), file => $operstate_file});
chomp $operstate;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { operstate => $operstate }});
$anvil->data->{bond_health}{$device}{interface}{$this_device}{up} = $operstate eq "up" ? 1 : 0;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"bond_health::${device}::interface::${this_device}::operstate" => $anvil->data->{bond_health}{$device}{interface}{$this_device}{operstate},
}});
}
}
}
# Read in the /proc file.
my $proc_file = "/proc/net/bonding/".$device;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { proc_file => $proc_file }});
my $in_link = "";
my $file_body = $anvil->Storage->read_file({debug => $debug, file => $proc_file});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { file_body => $file_body }});
foreach my $line (split/\n/, $file_body)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
if ($line =~ /Slave Interface: (.*)$/)
{
$in_link = $1;
$anvil->data->{bond_health}{$device}{active_links}++;
$anvil->data->{bond_health}{$device}{interface}{$in_link}{in_bond} = 1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"bond_health::${device}::active_links" => $anvil->data->{bond_health}{$device}{active_links},
"bond_health::${device}::interface::${in_link}::in_bond" => $anvil->data->{bond_health}{$device}{interface}{$in_link}{in_bond},
}});
next;
}
if (not $line)
{
$in_link = "";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { in_link => $in_link }});
next;
}
if ($in_link)
{
if ($line =~ /MII Status: (.*)$/)
{
my $status = $1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { status => $status }});
if ($status eq "up")
{
$anvil->data->{bond_health}{$device}{up_links}++;
$anvil->data->{bond_health}{$device}{interface}{$in_link}{up} = 1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"bond_health::${device}::up_links" => $anvil->data->{bond_health}{$device}{up_links},
"bond_health::${device}::interface::${in_link}::up" => $anvil->data->{bond_health}{$device}{interface}{$in_link}{up},
}});
}
else
{
$anvil->data->{bond_health}{$device}{interface}{$in_link}{up} = 0;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"bond_health::${device}::interface::${in_link}::up" => $anvil->data->{bond_health}{$device}{interface}{$in_link}{up},
}});
}
next;
}
}
else
{
if ($line =~ /MII Status: (.*)$/)
{
my $status = $1;
$anvil->data->{bond_health}{$device}{up} = $status eq "up" ? 1 : 0;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
status => $status,
"bond_health::${device}::up" => $anvil->data->{bond_health}{$device}{up},
}});
next;
}
}
}
}
}
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# Before we check the bonds, check the bridges. Bonds won't come up if they're in a bridge that is
# down.
my $bridge_count = keys %{$anvil->data->{bridge_health}};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { bridge_count => $bridge_count }});
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
if (($bridge_count) && (not $heal eq "none"))
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
{
foreach my $bridge (sort {$a cmp $b} keys %{$anvil->data->{bridge_health}})
{
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my $up = $anvil->data->{bridge_health}{$bridge}{up};
my $name = $anvil->data->{bridge_health}{$bridge}{name};
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
bridge => $bridge,
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
name => $name,
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
up => $up,
}});
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
if (not $up)
{
# Try to recover the interface
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, 'print' => 1, level => 1, key => "log_0632", variables => { bridge => $bridge }});
my $shell_call = $anvil->data->{path}{exe}{ifup}." ".$name;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { shell_call => $shell_call }});
my ($output, $return_code) = $anvil->System->call({debug => $debug, shell_call => $shell_call});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
'output' => $output,
'return_code' => $return_code,
}});
}
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
}
}
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
foreach my $bond (sort {$a cmp $b} keys %{$anvil->data->{bond_health}})
{
Note: Continuing to resolve the build issues with network startup. Expect breakage. * Upped the aging of jobs and alerts data from 2 to 24 hours. Also added a check to prevent deleting a job of any age that is incomplete. * Major update to anvil-configure-host to not touch the network unless something has actually changed. Not yet tested on a fresh system, will verify nothing broke in the CI tests this commit will trigger. Also changed it so that, if after reconfiguring the network it times out trying to reconnect to a database, it calls a reboot instead of simply exiting. Further, a reboot is now not called on exit unless something changed to require it. * Updated Network->check_bonds() to return '1' if anything was done to heal a bond. * Updated anvil-update-states to be more careful about clearing virsh bridges. Specifically, it checks to see if virsh is running and that the returned bridges aren't actually error codes. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => 2, list => {
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
"s1:bond_health::${bond}::name" => $anvil->data->{bond_health}{$bond}{name},
"s2:bond_health::${bond}::up" => $anvil->data->{bond_health}{$bond}{up},
"s3:bond_health::${bond}::configured_links" => $anvil->data->{bond_health}{$bond}{configured_links},
"s4:bond_health::${bond}::active_links" => $anvil->data->{bond_health}{$bond}{active_links},
"s5:bond_health::${bond}::up_links" => $anvil->data->{bond_health}{$bond}{up_links},
}});
foreach my $interface (sort {$a cmp $b} keys %{$anvil->data->{bond_health}{$bond}{interface}})
{
Note: Continuing to resolve the build issues with network startup. Expect breakage. * Upped the aging of jobs and alerts data from 2 to 24 hours. Also added a check to prevent deleting a job of any age that is incomplete. * Major update to anvil-configure-host to not touch the network unless something has actually changed. Not yet tested on a fresh system, will verify nothing broke in the CI tests this commit will trigger. Also changed it so that, if after reconfiguring the network it times out trying to reconnect to a database, it calls a reboot instead of simply exiting. Further, a reboot is now not called on exit unless something changed to require it. * Updated Network->check_bonds() to return '1' if anything was done to heal a bond. * Updated anvil-update-states to be more careful about clearing virsh bridges. Specifically, it checks to see if virsh is running and that the returned bridges aren't actually error codes. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => 2, list => {
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
"s1:bond_health::${bond}::interface::${interface}::name" => $anvil->data->{bond_health}{$bond}{interface}{$interface}{name},
"s2:bond_health::${bond}::interface::${interface}::in_bond" => $anvil->data->{bond_health}{$bond}{interface}{$interface}{in_bond},
"s3:bond_health::${bond}::interface::${interface}::up" => $anvil->data->{bond_health}{$bond}{interface}{$interface}{up},
"s4:bond_health::${bond}::interface::${interface}::carrier" => $anvil->data->{bond_health}{$bond}{interface}{$interface}{carrier},
}});
}
if ($anvil->data->{bond_health}{$bond}{configured_links} != $anvil->data->{bond_health}{$bond}{up_links})
{
next if $heal eq "none";
next if (($anvil->data->{bond_health}{$bond}{up}) && ($heal eq "down_only"));
# Log that we're going to try to heal this bond.
if ($heal eq "down_only")
{
# Log that we're healing fully down bonds.
Note: Continuing to resolve the build issues with network startup. Expect breakage. * Upped the aging of jobs and alerts data from 2 to 24 hours. Also added a check to prevent deleting a job of any age that is incomplete. * Major update to anvil-configure-host to not touch the network unless something has actually changed. Not yet tested on a fresh system, will verify nothing broke in the CI tests this commit will trigger. Also changed it so that, if after reconfiguring the network it times out trying to reconnect to a database, it calls a reboot instead of simply exiting. Further, a reboot is now not called on exit unless something changed to require it. * Updated Network->check_bonds() to return '1' if anything was done to heal a bond. * Updated anvil-update-states to be more careful about clearing virsh bridges. Specifically, it checks to see if virsh is running and that the returned bridges aren't actually error codes. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$repaired = 1;
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, 'print' => 1, level => 1, key => "log_0627", variables => { bond => $bond }});
}
else
{
# Log that we're healing all bond links
Note: Continuing to resolve the build issues with network startup. Expect breakage. * Upped the aging of jobs and alerts data from 2 to 24 hours. Also added a check to prevent deleting a job of any age that is incomplete. * Major update to anvil-configure-host to not touch the network unless something has actually changed. Not yet tested on a fresh system, will verify nothing broke in the CI tests this commit will trigger. Also changed it so that, if after reconfiguring the network it times out trying to reconnect to a database, it calls a reboot instead of simply exiting. Further, a reboot is now not called on exit unless something changed to require it. * Updated Network->check_bonds() to return '1' if anything was done to heal a bond. * Updated anvil-update-states to be more careful about clearing virsh bridges. Specifically, it checks to see if virsh is running and that the returned bridges aren't actually error codes. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$repaired = 1;
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, 'print' => 1, level => 1, key => "log_0628", variables => { bond => $bond }});
}
* Finished updating Network->check_network() to check/heal bridges. * Updated anvil-configure-host to not reboot on network chane (will verify when this commit is function tested). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# For good measure, try to up the bond as well.
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, 'print' => 1, level => 1, key => "log_0630", variables => { bond => $bond }});
my $shell_call = $anvil->data->{path}{exe}{ifup}." ".$anvil->data->{bond_health}{$bond}{name};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { shell_call => $shell_call }});
my ($output, $return_code) = $anvil->System->call({debug => $debug, shell_call => $shell_call});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
'output' => $output,
'return_code' => $return_code,
}});
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# If we're here, try to bring up down'ed interfaces.
foreach my $interface (sort {$a cmp $b} keys %{$anvil->data->{bond_health}{$bond}{interface}})
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"s2:bond_health::${bond}::interface::${interface}::in_bond" => $anvil->data->{bond_health}{$bond}{interface}{$interface}{in_bond},
"s4:bond_health::${bond}::interface::${interface}::carrier" => $anvil->data->{bond_health}{$bond}{interface}{$interface}{carrier},
}});
if ((not $anvil->data->{bond_health}{$bond}{interface}{$interface}{in_bond}) && ($anvil->data->{bond_health}{$bond}{interface}{$interface}{carrier}))
{
# Link shown, try to start the interface.
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, 'print' => 1, level => 1, key => "log_0629", variables => {
bond => $bond,
* Continuing to try to get the network to reliably start during configuration... Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
interface => $interface." (".$anvil->data->{bond_health}{$bond}{interface}{$interface}{name}.")",
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
}});
my $shell_call = $anvil->data->{path}{exe}{ifup}." ".$anvil->data->{bond_health}{$bond}{interface}{$interface}{name};
* Continuing to try to get the network to reliably start during configuration... Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => 1, list => { shell_call => $shell_call }});
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
* Continuing to try to get the network to reliably start during configuration... Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my ($output, $return_code) = $anvil->System->call({debug => 1, shell_call => $shell_call});
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
'output' => $output,
'return_code' => $return_code,
}});
}
}
}
}
Note: Continuing to resolve the build issues with network startup. Expect breakage. * Upped the aging of jobs and alerts data from 2 to 24 hours. Also added a check to prevent deleting a job of any age that is incomplete. * Major update to anvil-configure-host to not touch the network unless something has actually changed. Not yet tested on a fresh system, will verify nothing broke in the CI tests this commit will trigger. Also changed it so that, if after reconfiguring the network it times out trying to reconnect to a database, it calls a reboot instead of simply exiting. Further, a reboot is now not called on exit unless something changed to require it. * Updated Network->check_bonds() to return '1' if anything was done to heal a bond. * Updated anvil-update-states to be more careful about clearing virsh bridges. Specifically, it checks to see if virsh is running and that the returned bridges aren't actually error codes. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
return($repaired);
* Created Network->check_bonds() that checks to see if any bonds are down, or if any interfaces configured to be in a bond are not actually in it. It accepts a 'heal' parameter that, by default, will bring up a bond with no active links, but leaves degraded bonds alone. It call also take 'all' and will try to bring up any missing interfaces. This distinction exists so that if a link is flaky and someone takes it down manually until it can be repaired, it doesn't get turned back on. * Updated anvil-daemon to call Network->check_bonds() with 'all' on startup, then woth 'down_only' once per minute to try to heal down'ed bonds. * Updated anvil-watch-bonds to take a 'run-once' switch and exit after one report, if set. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
}
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 check_internet
This method tries to connect to the internet. If successful, C<< 1 >> is returned. Otherwise, C<< 0 >> is returned.
Paramters;
=head3 domains (optional, default 'defaults::network::test::domains')
If passed an array reference, the domains in the array will be checked in the order they are found in the array. As soon as any respond to a ping, the check exits and C<< 1 >> is returned.
If not passed, C<< defaults::network::test::domains >> are used.
=head3 password (optional)
If C<< target >> is set, this is the password used to log into the remote system as the C<< remote_user >>. If it is not set, an attempt to connect without a password will be made (though this will usually fail).
=head3 port (optional, default 22)
If C<< target >> is set, this is the TCP port number used to connect to the remote machine.
=head3 remote_user (optional)
If C<< target >> is set, this is the user account that will be used when connecting to the remote system.
=head3 target (optional)
If set, the file will be read from the target machine. This must be either an IP address or a resolvable host name.
=head3 tries (optional, default 3)
This is how many times we'll try to ping the target. Pings are done one ping at a time, so that if the first ping succeeds, the test can exit quickly and return success.
=cut
sub check_internet
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->check_internet()" }});
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $access = 0;
my $domains = defined $parameter->{domains} ? $parameter->{domains} : $anvil->data->{defaults}{network}{test}{domains};
my $password = defined $parameter->{password} ? $parameter->{password} : "";
my $port = defined $parameter->{port} ? $parameter->{port} : 22;
my $remote_user = defined $parameter->{remote_user} ? $parameter->{remote_user} : "root";
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $target = defined $parameter->{target} ? $parameter->{target} : "";
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $tries = defined $parameter->{tries} ? $parameter->{tries} : 3;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
domains => $domains,
password => $anvil->Log->is_secure($password),
port => $port,
remote_user => $remote_user,
target => $target,
tries => $tries,
}});
if (ref($domains) eq "ARRAY")
{
my $domain_count = @{$domains};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { domain_count => $domain_count }});
if (not $domain_count)
{
# Array is empty
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0440", variables => { name => "domain" }});
return($access);
}
}
else
{
# Domains isn't an array.
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0218", variables => { name => "domain", value => $domains }});
return($access);
}
if (($tries =~ /\D/) or ($tries < 1))
{
# Invalid
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0441", variables => { name => "tries", value => $tries }});
return($access);
}
foreach my $domain (@{$domains})
{
# Is the domain valid?
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { domain => $domain }});
* Renamed all Validate->is_X to Validate->X. Also created Validate->ipv6() to validate IPv6 addresses using Data::Validate::IP (and added it as a requirement to the .spec base RPM). * Added the fix from the last commit for System->call to handle returned data without an ending newline to Remote->call. * Got more work done on System->update_hosts(). It's able to add new hosts, but misses the short and FQDN host names. Need to fix that and the verify existing / manual entries aren't molested. Signed-off-by: digimer <digimer@pulsar.alteeve.com>
4 years ago
if ((not $anvil->Validate->domain_name({debug => $debug, name => $domain})) and
(not $anvil->Validate->ipv4({debug => $debug, ip => $domain})))
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Not valid, skip
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0442", variables => { name => $domain }});
next;
}
* Created Convert->fence_ipmilan_to_ipmitool() that takes a 'fence_ipmilan' call and converts it into a direct 'ipmitool' call. * Created Database->get_power() that loads data from the special 'power' table. * Fixed a bug in calls to Network->ping() where some weren't formatted properly for receiving two string variables. * Updated Database->get_anvils() to record the machine types when recording host information. * Updated Database->get_hosts_info() to also load the 'host_ipmi' column. * Updated Database->get_upses() to store the link to the 'power' -> 'power_uuid', when available. * Created ScanCore->call_scan_agents() that does the work of actually calling scan agents, moving the logic out from the scancore daemon. * Created ScanCore->check_power() that takes a host and the anvil it is in and returns if it's on batteries or not. If it is, the time on batteries and estimate hold-up time is returned. If not, the highest charge percentage is returned. * Created ScanCore->post_scan_analysis() that is a wrapper for calling the new ->post_scan_analysis_dr(), ->post_scan_analysis_node() and ->post_scan_analysis_striker(). Of which, _dr and _node are still empty, but _striker is complete. ** ->post_scan_analysis_striker() is complete. It now boots a node after a power loss if the UPSes powering it are OK (at least one has mains power, and the main-powered UPS(es) have reached the minimum charge percentage). If it's thermal, IPMI is called and so long as at least one thermal sensor is found and it/they are all OK, it is booted. For now, M2's thermal reboot delay logic hasn't been replicated, as it added a lot of complexity and didn't prove practically useful. * Created System->collect_ipmi_data() and moved 'scan_ipmitool's ipmitool call and parse into that method. This was done to allow ScanCore->post_scan_analysis_striker() to also call IPMI on a remote machine during thermal down events without reimplementing the logic. * Updated scan-ipmitool to only record temperature data for data collected locally. Also renamed 'machine' variables and hash keys to 'host_name' to clarify what is being stored. * Updated scancore to clear the 'system::stop_reason' variable. * Added missing packages to striker-manage-install-target. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
my ($pinged, $average_time) = $anvil->Network->ping({
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
debug => $debug,
target => $target,
port => $port,
password => $password,
remote_user => $remote_user,
ping => $domain,
count => 3,
});
* Created Convert->fence_ipmilan_to_ipmitool() that takes a 'fence_ipmilan' call and converts it into a direct 'ipmitool' call. * Created Database->get_power() that loads data from the special 'power' table. * Fixed a bug in calls to Network->ping() where some weren't formatted properly for receiving two string variables. * Updated Database->get_anvils() to record the machine types when recording host information. * Updated Database->get_hosts_info() to also load the 'host_ipmi' column. * Updated Database->get_upses() to store the link to the 'power' -> 'power_uuid', when available. * Created ScanCore->call_scan_agents() that does the work of actually calling scan agents, moving the logic out from the scancore daemon. * Created ScanCore->check_power() that takes a host and the anvil it is in and returns if it's on batteries or not. If it is, the time on batteries and estimate hold-up time is returned. If not, the highest charge percentage is returned. * Created ScanCore->post_scan_analysis() that is a wrapper for calling the new ->post_scan_analysis_dr(), ->post_scan_analysis_node() and ->post_scan_analysis_striker(). Of which, _dr and _node are still empty, but _striker is complete. ** ->post_scan_analysis_striker() is complete. It now boots a node after a power loss if the UPSes powering it are OK (at least one has mains power, and the main-powered UPS(es) have reached the minimum charge percentage). If it's thermal, IPMI is called and so long as at least one thermal sensor is found and it/they are all OK, it is booted. For now, M2's thermal reboot delay logic hasn't been replicated, as it added a lot of complexity and didn't prove practically useful. * Created System->collect_ipmi_data() and moved 'scan_ipmitool's ipmitool call and parse into that method. This was done to allow ScanCore->post_scan_analysis_striker() to also call IPMI on a remote machine during thermal down events without reimplementing the logic. * Updated scan-ipmitool to only record temperature data for data collected locally. Also renamed 'machine' variables and hash keys to 'host_name' to clarify what is being stored. * Updated scancore to clear the 'system::stop_reason' variable. * Added missing packages to striker-manage-install-target. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
pinged => $pinged,
average_time => $average_time,
}});
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if ($pinged)
{
$access = 1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { access => $access }});
}
last if $pinged;
}
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { access => $access }});
return($access);
}
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 download
This downloads a file from a network target and saves it to a local file. This must be called on a local system so that the download progress can be reported.
On success, the saved file is returned. On failure, an empty string is returned.
Parameters;
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head3 overwrite (optional, default '0')
When set, if the output file already exists, the existing file will be removed before the download is called.
B<< NOTE >>: If the output file already exists and is 0-bytes, it is removed and the download proceeds regardless of this setting.
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head3 save_to (optional)
If set, this is where the file will be downloaded to. If this ends with C<< / >>, the file name is preserved from the C<< url >> and will be saved in the C<< save_to >>'s directory with the original file name. Otherwise, the downlaoded file is saved with the file name given. As such, be careful about the trailing C<< / >>!
When not specified, the file name in the URL will be used and the file will be saved in the active user's home directory.
=head3 status (optional, default '1')
When set to C<< 1 >>, a periodic status message is printed. When set to C<< 0 >>, no status will be printed.
=head3 url (required)
This is the URL to the file to download.
=cut
sub download
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
* Created the new tools/striker-scan-network tool that ping scans a network range and records the discovered hosts in the new 'mac_to_ip' table. Also created Database->insert_or_update_mac_to_ip() to handle the new table. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->download()" }});
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $overwrite = defined $parameter->{overwrite} ? $parameter->{overwrite} : 0;
my $save_to = defined $parameter->{save_to} ? $parameter->{save_to} : "";
my $status = defined $parameter->{status} ? $parameter->{status} : 1;
my $url = defined $parameter->{url} ? $parameter->{url} : "";
my $uuid = $anvil->Get->uuid();
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
overwrite => $overwrite,
save_to => $save_to,
status => $status,
url => $url,
uuid => $uuid,
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
if (not $url)
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->download()", parameter => "url" }});
return("");
}
elsif (($url !~ /^ftp\:\/\//) && ($url !~ /^http\:\/\//) && ($url !~ /^https\:\/\//))
{
# Invalid URL.
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "error_0085", variables => { url => $url }});
return("");
}
# The name of the file to be downloaded will be used if the path isn't specified, or if it ends in '/'.
my $source_file = ($url =~ /^.*\/(.*)$/)[0];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { source_file => $source_file }});
if (not $save_to)
{
$save_to = $anvil->Get->users_home({debug => $debug})."/".$source_file;
$save_to =~ s/\/\//\//g;
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => 0, list => { save_to => $save_to }});
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
elsif ($save_to =~ /\/$/)
{
$save_to .= "/".$source_file;
$save_to =~ s/\/\//\//g;
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => 0, list => { save_to => $save_to }});
}
# Does the download file exist already?
if (-e $save_to)
{
# If overwrite is set, or if the file is zero-bytes, remove it.
my $size = (stat($save_to))[7];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
size => $size." (".$anvil->Convert->bytes_to_human_readable({'bytes' => $size}).")",
}});
if (($overwrite) or ($size == 0))
{
unlink $save_to;
}
else
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, key => "error_0094", variables => {
url => $url,
save_to => $save_to,
}});
return("");
}
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
### TODO: Make this work well as a job
my $status_file = "/tmp/".$source_file.".download_status";
my $bytes_downloaded = 0;
my $running_time = 0;
my $average_rate = 0;
my $start_printed = 0;
my $percent = 0;
my $rate = 0; # Bytes/sec
my $downloaded = 0; # Bytes
my $time_left = 0; # Seconds
my $report_interval = 5; # Seconds between status file update
my $next_report = time + $report_interval;
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $error = 0;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# This should print to a status file
print "uuid=$uuid bytes_downloaded=0 percent=0 current_rate=0 average_rate=0 seconds_running=0 seconds_left=0 url=$url save_to=$save_to\n" if $status;;
# Download command
my $unix_start = 0;
my $shell_call = $anvil->data->{path}{exe}{wget}." -c --progress=dot:binary ".$url." -O ".$save_to;
my $output = "";
open (my $file_handle, $shell_call." 2>&1 |") or $anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, secure => 0, priority => "err", key => "log_0014", variables => { shell_call => $shell_call, error => $! }});
while(<$file_handle>)
{
chomp;
my $line = $_;
$line =~ s/^\s+//;
$line =~ s/\s+$//;
$line =~ s/\s+/ /g;
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, secure => 0, key => "log_0017", variables => { line => $line }});
if (($line =~ /404/) && ($line =~ /Not Found/i))
{
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, secure => 0, priority => "err", key => "error_0086", variables => { url => $url }});
$error = 1;;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
if ($line =~ /Name or service not known/i)
{
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, secure => 0, priority => "err", key => "error_0087", variables => { url => $url }});
$error = 1;;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
if ($line =~ /Connection refused/i)
{
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, secure => 0, priority => "err", key => "error_0088", variables => { url => $url }});
$error = 1;;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
if ($line =~ /route to host/i)
{
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, secure => 0, priority => "err", key => "error_0089", variables => { url => $url }});
$error = 1;;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
if ($line =~ /Network is unreachable/i)
{
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, secure => 0, priority => "err", key => "error_0090", variables => { url => $url }});
$error = 1;;
}
if ($line =~ /ERROR (\d+): (.*)$/i)
{
my $error_code = $1;
my $error_message = $2;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
error_code => $error_code,
error_message => $error_message,
}});
if ($error_code eq "403")
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, secure => 0, priority => "err", key => "error_0091", variables => { url => $url }});
}
elsif ($error_code eq "404")
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, secure => 0, priority => "err", key => "error_0092", variables => { url => $url }});
}
else
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, secure => 0, priority => "err", key => "error_0093", variables => {
url => $url,
error_code => $error_code,
error_message => $error_message,
}});
}
$error = 1;;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
if ($line =~ /^(\d+)K .*? (\d+)% (.*?) (\d+.*)$/)
{
$downloaded = $1;
$percent = $2;
$rate = $3;
$time_left = $4;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
downloaded => $downloaded,
percent => $percent,
rate => $rate,
time_left => $time_left,
}});
if (not $start_printed)
{
### NOTE: This is meant to be parsed by a script, so don't translate it.
print "started:$uuid\n" if $status;
$start_printed = 1;
}
### NOTE: According to: http://savannah.gnu.org/bugs/index.php?22765, wget uses base-2.
# Convert
$bytes_downloaded = $downloaded * 1024;
my $say_downloaded = $anvil->Convert->bytes_to_human_readable({'bytes' => $bytes_downloaded});
my $say_percent = $percent."%";
my $byte_rate = $anvil->Convert->human_readable_to_bytes({size => $rate, base2 => 1});
my $say_rate = $anvil->Convert->bytes_to_human_readable({'bytes' => $byte_rate})."/s";
$running_time = time - $unix_start;
my $say_running_time = $anvil->Convert->time({'time' => $running_time, translate => 1});
# Time left is a bit more complicated
my $days = 0;
my $hours = 0;
my $minutes = 0;
my $seconds = 0;
if ($time_left =~ /(\d+)d/)
{
$days = $1;
#print "$THIS_FILE ".__LINE__."; == days: [$days]\n";
}
if ($time_left =~ /(\d+)h/)
{
$hours = $1;
#print "$THIS_FILE ".__LINE__."; == hours: [$hours]\n";
}
if ($time_left =~ /(\d+)m/)
{
$minutes = $1;
#print "$THIS_FILE ".__LINE__."; == minutes: [$minutes]\n";
}
if ($time_left =~ /(\d+)s/)
{
$seconds = $1;
#print "$THIS_FILE ".__LINE__."; == seconds: [$seconds]\n";
}
my $seconds_left = (($days * 86400) + ($hours * 3600) + ($minutes * 60) + $seconds);
my $say_time_left = $anvil->Convert->time({'time' => $seconds_left, long => 1, translate => 1});
$running_time = 1 if not $running_time;
$average_rate = int($bytes_downloaded / $running_time);
my $say_average_rate = $anvil->Convert->bytes_to_human_readable({'bytes' => $average_rate})."/s";
#print "$THIS_FILE ".__LINE__."; downloaded: [$downloaded], bytes_downloaded: [$bytes_downloaded], say_downloaded: [$say_downloaded], percent: [$percent], rate: [$rate], byte_rate: [$byte_rate], say_rate: [$say_rate], time_left: [$time_left]\n";
if (time > $next_report)
{
#print "$THIS_FILE ".__LINE__."; say_downloaded: [$say_downloaded], percent: [$percent], say_rate: [$say_rate], running_time: [$running_time], say_running_time: [$say_running_time], seconds_left: [$seconds_left], say_time_left: [$say_time_left]\n";
#print "$file; Downloaded: [$say_downloaded]/[$say_percent], Rate/Avg: [$say_rate]/[$say_average_rate], Running: [$say_running_time], Left: [$say_time_left]\n";
#print "$THIS_FILE ".__LINE__."; bytes_downloaded=$bytes_downloaded, percent=$percent, current_rate=$byte_rate, average_rate=$average_rate, seconds_running=$running_time, seconds_left=$seconds_left, save_to=$save_to\n";
$next_report += $report_interval;
# This should print to a status file
print "uuid=$uuid bytes_downloaded=$bytes_downloaded percent=$percent current_rate=$byte_rate average_rate=$average_rate seconds_running=$running_time seconds_left=$seconds_left url=$url save_to=$save_to\n" if $status;
}
}
}
close $file_handle;
chomp($output);
* Created the 'oui' database table that stores the parsed OUI data, as processed by the new 'tools/striker-parse-oui' tool. Also created Database->insert_or_update_oui() to handle inserts and updates. * Fixed a bug in Convert->time() where the suffix was long when it should have been short, and vice-versa. * Updated Network->download() to check if the target file exists and, if so, to abort unless 'overwrite' is given or the existing file is 0-bytes long. Also updated it to not exit on immediate error after the wget call and instead check to see if a zero-byte file exists and remove it, if so. * Created Validate->is_hex() to check hexadecimal strings. * Updated Words->clean_spaces() to remove MS-DOS-style ^M cr/lf characters. * Updated anvil-daemon to have a section for periodic tasks that run daily, and added striker-parse-oui as well as moved striker-manage-install-target refresh to that check. Also made those tools run on dashboards only. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { error => $error }});
if ($error)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { save_to => $save_to }});
if (-e $save_to)
{
# Unlink the output file, it's empty.
my $size = (stat($save_to))[7];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
size => $size." (".$anvil->Convert->bytes_to_human_readable({'bytes' => $size}).")",
}});
if (not $size)
{
unlink $save_to;
}
}
return("");
}
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return($save_to);
}
* Got the 'anvil-provision-server' script to the point where it actually saves the new server job. * Created the new method Cluster->get_primary_host_uuid() that returns the 'host_uuid' of the primary node in the given cluster. This is useful for external programs to figure out which node is primary. Example is provisioning a new server being assigned to the active node. Also created ->is_primary() that is a similar test to see if the active node is the primary node or not. * Updated Cluster->parse_cib() and ->parse_crm_mon() to work on remote hosts. * Updated Database->get_hosts() to store the short host names. * Created Get->host_from_ip_address() that translates an IP address to a host_uuid and host_name, if it's an IP assigned currently to a known host. * Created Network->find_target_ip() that simplifies finding which IP address to use when the caller wants to connect to a target host. * Reworked the anvil-join-anvil to parse fence_arguments in a way that handles passwords with spaces in them. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 find_matches
* Started working on getting database archiving working. It's close to done, but needs testing/debugging and other finery. * Created Database->get_host_from_uuid() that takes a host UUID and returns the host's name. * Reworked Network->find_matches() to return both the match's IP and subnet. * Finished getting tools/striker-initialize-host to add all known peers to the target, using IPs on the target's available subnet. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
This takes two hash keys from prior C<< Network->get_ips() >> or C<< ->load_ips() >> runs and finds which are on the same network.
A hash reference is returned using the format:
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* <first>::<interface>::ip = <ip_address>
* <first>::<interface>::subnet_mask = <subnet_mask>
* <second>::<interface>::ip = <ip_address>
* <second>::<interface>::subnet_mask = <subnet_mask>
* Started working on getting database archiving working. It's close to done, but needs testing/debugging and other finery. * Created Database->get_host_from_uuid() that takes a host UUID and returns the host's name. * Reworked Network->find_matches() to return both the match's IP and subnet. * Finished getting tools/striker-initialize-host to add all known peers to the target, using IPs on the target's available subnet. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
Where C<< first >> and C<< second >> are the parameters passed in below and C<< interface >> is the name of the interface on the fist/second machine that can talk to one another.
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
Paramters;
=head3 first (required)
This is the hash key of the first machine being compared.
=head3 second (required)
This is the hash key of the second machine being compared.
=cut
sub find_matches
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->find_matches()" }});
my $first = defined $parameter->{first} ? $parameter->{first} : "";
my $second = defined $parameter->{second} ? $parameter->{second} : "";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
first => $first,
* Fixed a resync bug where bridges needed to sync before bonds * Re-enabled user-selected BCN subnet ranges (needs more testing). Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
second => $second,
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
* Finished the jquery/css stuff for showing the list of hosts that can have their network configured. * Fixed unclear error logging in Network->find_matches(). * Updated System->generate_state_json() Striker->parse_all_status_json() to determine if another machine can be reached from the local dashboard. If it can be reached, the first matching interface and IP are recorded. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (not $first)
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->find_matches()", parameter => "first" }});
return("");
}
* Finished the jquery/css stuff for showing the list of hosts that can have their network configured. * Fixed unclear error logging in Network->find_matches(). * Updated System->generate_state_json() Striker->parse_all_status_json() to determine if another machine can be reached from the local dashboard. If it can be reached, the first matching interface and IP are recorded. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
elsif (ref($anvil->data->{network}{$first}) ne "HASH")
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "error_0106", variables => { key => "first -> network::".$first }});
return("");
}
if (not $second)
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->find_matches()", parameter => "second" }});
return("");
}
* Finished the jquery/css stuff for showing the list of hosts that can have their network configured. * Fixed unclear error logging in Network->find_matches(). * Updated System->generate_state_json() Striker->parse_all_status_json() to determine if another machine can be reached from the local dashboard. If it can be reached, the first matching interface and IP are recorded. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
elsif (ref($anvil->data->{network}{$second}) ne "HASH")
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "error_0106", variables => { key => "second -> network::".$second }});
return("");
}
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# Loop through the first, and on each interface with an IP/subnet mask, look for a match in the second.
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $match = {};
foreach my $first_interface (sort {$b cmp $a} keys %{$anvil->data->{network}{$first}{interface}})
{
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $first_ip = $anvil->data->{network}{$first}{interface}{$first_interface}{ip};
my $first_subnet_mask = $anvil->data->{network}{$first}{interface}{$first_interface}{subnet_mask};
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
first => $first,
first_interface => $first_interface,
first_ip => $first_ip,
first_subnet_mask => $first_subnet_mask,
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (($first_ip) && ($first_subnet_mask))
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Look for a match.
my $first_network = $anvil->Network->get_network({
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
debug => $debug,
ip => $first_ip,
subnet_mask => $first_subnet_mask,
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { a_network => $first_network }});
foreach my $second_interface (sort {$b cmp $a} keys %{$anvil->data->{network}{$second}{interface}})
{
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $second_ip = $anvil->data->{network}{$second}{interface}{$second_interface}{ip};
my $second_subnet_mask = $anvil->data->{network}{$second}{interface}{$second_interface}{subnet_mask};
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
second => $second,
second_interface => $second_interface,
second_ip => $second_ip,
second_subnet_mask => $second_subnet_mask,
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (($second_ip) && ($second_subnet_mask))
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Do we have a match?
my $second_network = $anvil->Network->get_network({
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
debug => $debug,
ip => $second_ip,
subnet_mask => $second_subnet_mask,
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
a_network => $first_network,
b_network => $second_network,
}});
if ($first_network eq $second_network)
{
# Match!
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$match->{$first}{$first_interface}{ip} = $first_ip;
$match->{$first}{$first_interface}{subnet_mask} = $second_network;
$match->{$second}{$second_interface}{ip} = $second_ip;
$match->{$second}{$second_interface}{subnet_mask} = $first_network;
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"${first}::${first_interface}::ip" => $match->{$first}{$first_interface}{ip},
"${first}::${first_interface}::subnet_mask" => $match->{$first}{$first_interface}{subnet_mask},
"${second}::${second_interface}::ip" => $match->{$second}{$second_interface}{ip},
"${second}::${second_interface}::subnet_mask" => $match->{$second}{$second_interface}{subnet_mask},
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
}
}
}
}
}
return($match);
}
* Got the 'anvil-provision-server' script to the point where it actually saves the new server job. * Created the new method Cluster->get_primary_host_uuid() that returns the 'host_uuid' of the primary node in the given cluster. This is useful for external programs to figure out which node is primary. Example is provisioning a new server being assigned to the active node. Also created ->is_primary() that is a similar test to see if the active node is the primary node or not. * Updated Cluster->parse_cib() and ->parse_crm_mon() to work on remote hosts. * Updated Database->get_hosts() to store the short host names. * Created Get->host_from_ip_address() that translates an IP address to a host_uuid and host_name, if it's an IP assigned currently to a known host. * Created Network->find_target_ip() that simplifies finding which IP address to use when the caller wants to connect to a target host. * Reworked the anvil-join-anvil to parse fence_arguments in a way that handles passwords with spaces in them. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
=head2 find_target_ip
This uses the IP information for the local machine and a target host UUID, and returns an IP address that can be used to contact it. When multiple networks are shared, the BCN IP is used. If no match is found, an empty string is returned.
* Moved the scan-drbd function 'gather_drbd_date' and moved it into DRBD->gather_date(). * Finished DRBD->get_next_resource() that returns the next available minor and the next free TCP port (with two free ports available after it). * Created Storage->get_storage_group_details() that pulls together the LVM, storage group members and storage groups into one block of data. * Made more progress on tools/anvil-provision-server. It now gets up to the point of creating LVs, creating DRBD resource files, loading them, creating metadata and up'ing the resource. It doesn't yet (successfully) force a new resource to primary. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
my $target_ip = $anvil->Network->find_target_ip({host_uuid => "8da3d2fe-783a-4619-abb5-8ccae58f7bd6"});
* Got the 'anvil-provision-server' script to the point where it actually saves the new server job. * Created the new method Cluster->get_primary_host_uuid() that returns the 'host_uuid' of the primary node in the given cluster. This is useful for external programs to figure out which node is primary. Example is provisioning a new server being assigned to the active node. Also created ->is_primary() that is a similar test to see if the active node is the primary node or not. * Updated Cluster->parse_cib() and ->parse_crm_mon() to work on remote hosts. * Updated Database->get_hosts() to store the short host names. * Created Get->host_from_ip_address() that translates an IP address to a host_uuid and host_name, if it's an IP assigned currently to a known host. * Created Network->find_target_ip() that simplifies finding which IP address to use when the caller wants to connect to a target host. * Reworked the anvil-join-anvil to parse fence_arguments in a way that handles passwords with spaces in them. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
Parameters;
=head3 host_uuid (required)
This is the target's C<< host_uuid >> that we're looking to contact.
=cut
sub find_target_ip
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->find_target_ip()" }});
my $target_ip = "";
my $host_uuid = defined $parameter->{host_uuid} ? $parameter->{host_uuid} : "";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
host_uuid => $host_uuid,
}});
if (not $host_uuid)
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->find_target_ip()", parameter => "host_uuid" }});
return("");
}
$anvil->Database->get_hosts();
if (not exists $anvil->data->{hosts}{host_uuid}{$host_uuid})
{
# Unknown host
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "error_0031", variables => { host_uuid => $host_uuid }});
return("");
}
my $target_host_name = $anvil->data->{hosts}{host_uuid}{$host_uuid}{short_host_name};
my $short_host_name = $anvil->Get->short_host_name({debug => $debug});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
target_host_name => $target_host_name,
short_host_name => $short_host_name,
}});
$anvil->Network->load_ips({
debug => $debug,
host_uuid => $anvil->Get->host_uuid,
host => $short_host_name,
clear => 1,
});
$anvil->Network->load_ips({
debug => $debug,
host_uuid => $host_uuid,
host => $target_host_name,
clear => 1,
});
my ($match) = $anvil->Network->find_matches({
debug => $debug,
first => $short_host_name,
second => $target_host_name,
});
if ($match)
{
# Yup!
my $match_found = 0;
foreach my $interface (sort {$a cmp $b} keys %{$match->{$target_host_name}})
{
$target_ip = $match->{$target_host_name}{$interface}{ip};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { target_ip => $target_ip }});
last;
}
}
return($target_ip);
}
* Updated the RPM spec file to generate '/etc/anvil/type.X' files to directly indicate the machine type. Updated System->get_host_type() to check for these files directly, falling back to parsing the host name if they don't exist. * Created Database->get_hosts_info() (though it's not at all finished) that will write out a unified JSON file contain all data known about all hosts/Anvil! systems. This will be later used to create the WebUI parts. * Also created, but also not finished, Network->load_interfces() that will work sort of like ->load_ups, but include all interfaces regardless of if they have an IP or not. * Fixed a bug where the new bridge_interface_note parameter didn't exist in the Database->insert_or_update_bridge_interfaces() method. * Updated anvil-update-states() to only write out the JSON/XML files if it's running on a dashboard. For nodes and DR hosts, it just needs to update the database. * Created a new hook in anvil-daemon that will call tasks on a machine that is configured. * As per RHEL 8.1 release notes, changed the package 'dnf-utils' to 'yum-utils' in the packages to load for install target repos. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 load_interfces
This loads all network information for the given host UUID.
The main difference from C<< ->load_ips() >> is that this method loads information about all interfaces, regardless of if they have an IP, as well as their link state and link information.
The loaded data will be stored as:
* C<< machine::<target>::interface::<iface_name>::
Parameters;
=head3 clear (optional, default '1')
When set, any previously known information is cleared. Specifically, the C<< network::<target>> >> hash is deleted prior to the load. To prevent this, set this to C<< 0 >>.
=head3 host (optional, default is 'host_uuid' value)
This is the optional C<< target >> string to use in the hash where the data is stored.
=head3 host_uuid (optional, default 'sys::host_uuid')
This is the C<< host_uuid >> of the hosts whose IP and interface data that you want to load. The default is to load the local machine's data.
=cut
sub load_interfces
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
* Fixed bugs in Striker->parse_all_status_json() and System->generate_state_json() where the connected interfaces to bridges and bonds wasn't be stored properly. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->load_interfces()" }});
* Updated the RPM spec file to generate '/etc/anvil/type.X' files to directly indicate the machine type. Updated System->get_host_type() to check for these files directly, falling back to parsing the host name if they don't exist. * Created Database->get_hosts_info() (though it's not at all finished) that will write out a unified JSON file contain all data known about all hosts/Anvil! systems. This will be later used to create the WebUI parts. * Also created, but also not finished, Network->load_interfces() that will work sort of like ->load_ups, but include all interfaces regardless of if they have an IP or not. * Fixed a bug where the new bridge_interface_note parameter didn't exist in the Database->insert_or_update_bridge_interfaces() method. * Updated anvil-update-states() to only write out the JSON/XML files if it's running on a dashboard. For nodes and DR hosts, it just needs to update the database. * Created a new hook in anvil-daemon that will call tasks on a machine that is configured. * As per RHEL 8.1 release notes, changed the package 'dnf-utils' to 'yum-utils' in the packages to load for install target repos. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $clear = defined $parameter->{clear} ? $parameter->{clear} : 1;
my $host_uuid = defined $parameter->{host_uuid} ? $parameter->{host_uuid} : $anvil->data->{sys}{host_uuid};
my $host = defined $parameter->{host} ? $parameter->{host} : "";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
clear => $clear,
host => $host,
host_uuid => $host_uuid,
}});
if (not $host_uuid)
{
* Fixed bugs in Striker->parse_all_status_json() and System->generate_state_json() where the connected interfaces to bridges and bonds wasn't be stored properly. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->load_interfces()", parameter => "host_uuid" }});
* Updated the RPM spec file to generate '/etc/anvil/type.X' files to directly indicate the machine type. Updated System->get_host_type() to check for these files directly, falling back to parsing the host name if they don't exist. * Created Database->get_hosts_info() (though it's not at all finished) that will write out a unified JSON file contain all data known about all hosts/Anvil! systems. This will be later used to create the WebUI parts. * Also created, but also not finished, Network->load_interfces() that will work sort of like ->load_ups, but include all interfaces regardless of if they have an IP or not. * Fixed a bug where the new bridge_interface_note parameter didn't exist in the Database->insert_or_update_bridge_interfaces() method. * Updated anvil-update-states() to only write out the JSON/XML files if it's running on a dashboard. For nodes and DR hosts, it just needs to update the database. * Created a new hook in anvil-daemon that will call tasks on a machine that is configured. * As per RHEL 8.1 release notes, changed the package 'dnf-utils' to 'yum-utils' in the packages to load for install target repos. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return("");
}
if (not $host)
{
$host = $host_uuid;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { host => $host }});
}
if (($clear) && (exists $anvil->data->{network}{$host}))
{
delete $anvil->data->{network}{$host};
}
* Added bonds -> bond_bridge_uuid to track which bridge, if any, that a bond is connected to. Updated Network->load_interfces() to record this. * Added missing foreign key references to the SQL schema. * Added support to tools/anvil-update-states to connect bonds to bridges, as appropriate. * Finished the logic in test.pl to pull the network data (with connections between bridges, bonds and interfaces) needed for the WebUI. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# Now load bridge info
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $query = "
* Added bonds -> bond_bridge_uuid to track which bridge, if any, that a bond is connected to. Updated Network->load_interfces() to record this. * Added missing foreign key references to the SQL schema. * Added support to tools/anvil-update-states to connect bonds to bridges, as appropriate. * Finished the logic in test.pl to pull the network data (with connections between bridges, bonds and interfaces) needed for the WebUI. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
SELECT
bridge_uuid,
bridge_name,
bridge_id,
bridge_mac_address,
bridge_mtu,
bridge_stp_enabled
FROM
bridges
WHERE
bridge_id != 'DELETED'
AND
bridge_host_uuid = ".$anvil->Database->quote($host_uuid)."
;";
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0124", variables => { query => $query }});
my $results = $anvil->Database->query({query => $query, source => $THIS_FILE, line => __LINE__});
my $count = @{$results};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
results => $results,
count => $count,
}});
foreach my $row (@{$results})
{
my $bridge_uuid = defined $row->[0] ? $row->[0] : "";
my $bridge_name = defined $row->[1] ? $row->[1] : "";
my $bridge_id = defined $row->[2] ? $row->[2] : "";
my $bridge_mac_address = defined $row->[3] ? $row->[3] : "";
my $bridge_mtu = defined $row->[4] ? $row->[4] : "";
my $bridge_stp_enabled = defined $row->[5] ? $row->[5] : "";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
bridge_uuid => $bridge_uuid,
bridge_name => $bridge_name,
bridge_id => $bridge_id,
bridge_mac_address => $bridge_mac_address,
bridge_mtu => $bridge_mtu,
bridge_stp_enabled => $bridge_stp_enabled,
}});
# Record the bridge_uuid -> name
$anvil->data->{network}{$host}{bridge_uuid}{$bridge_uuid}{name} = $bridge_name;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"network::${host}::bridge_uuid::${bridge_uuid}::name" => $anvil->data->{network}{$host}{bridge_uuid}{$bridge_uuid}{name},
}});
# We'll initially load empty strings for what would be the IP information. Any interface with IPs will be populated when we call
$anvil->data->{network}{$host}{interface}{$bridge_name}{uuid} = $bridge_uuid;
$anvil->data->{network}{$host}{interface}{$bridge_name}{id} = $bridge_id;
$anvil->data->{network}{$host}{interface}{$bridge_name}{mac_address} = $bridge_mac_address;
$anvil->data->{network}{$host}{interface}{$bridge_name}{mtu} = $bridge_mtu;
$anvil->data->{network}{$host}{interface}{$bridge_name}{stp_enabled} = $bridge_stp_enabled;
$anvil->data->{network}{$host}{interface}{$bridge_name}{type} = "bridge";
$anvil->data->{network}{$host}{interface}{$bridge_name}{interfaces} = [];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"network::${host}::interface::${bridge_name}::uuid" => $anvil->data->{network}{$host}{interface}{$bridge_name}{uuid},
"network::${host}::interface::${bridge_name}::id" => $anvil->data->{network}{$host}{interface}{$bridge_name}{id},
"network::${host}::interface::${bridge_name}::mac_address" => $anvil->data->{network}{$host}{interface}{$bridge_name}{mac_address},
"network::${host}::interface::${bridge_name}::mtu" => $anvil->data->{network}{$host}{interface}{$bridge_name}{mtu},
"network::${host}::interface::${bridge_name}::stp_enabled" => $anvil->data->{network}{$host}{interface}{$bridge_name}{stp_enabled},
"network::${host}::interface::${bridge_name}::type" => $anvil->data->{network}{$host}{interface}{$bridge_name}{type},
}});
}
# Now load bond info
$query = "
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
SELECT
bond_uuid,
bond_name,
bond_mode,
bond_mtu,
* Renamed 'primary_slave' to 'primary_interface' for the bond table. * Got more work done on parsing the all_status.json (and fixing related bugs). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_primary_interface,
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_primary_reselect,
* Renamed bond_active_slave to bond_active_interface. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_active_interface,
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_mii_polling_interval,
bond_up_delay,
bond_down_delay,
bond_mac_address,
* Added bonds -> bond_bridge_uuid to track which bridge, if any, that a bond is connected to. Updated Network->load_interfces() to record this. * Added missing foreign key references to the SQL schema. * Added support to tools/anvil-update-states to connect bonds to bridges, as appropriate. * Finished the logic in test.pl to pull the network data (with connections between bridges, bonds and interfaces) needed for the WebUI. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_operational,
bond_bridge_uuid
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
FROM
bonds WHERE bond_mode != 'DELETED'
AND
bond_host_uuid = ".$anvil->Database->quote($host_uuid)."
;";
* Added strings for making size suffixes translatable and updated Convert->bytes_to_human_readable to use them. * Fixed a bug in tools/anvil-update-states where the MAC of an interface that is the backup in an active-backup bond would be the MAC of the active member instead of its real MAC. * Fixed a bug in Convert->add_commas() where a passed in value of '0' returned an empty string. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0124", variables => { query => $query }});
* Added bonds -> bond_bridge_uuid to track which bridge, if any, that a bond is connected to. Updated Network->load_interfces() to record this. * Added missing foreign key references to the SQL schema. * Added support to tools/anvil-update-states to connect bonds to bridges, as appropriate. * Finished the logic in test.pl to pull the network data (with connections between bridges, bonds and interfaces) needed for the WebUI. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$results = $anvil->Database->query({query => $query, source => $THIS_FILE, line => __LINE__});
$count = @{$results};
* Added strings for making size suffixes translatable and updated Convert->bytes_to_human_readable to use them. * Fixed a bug in tools/anvil-update-states where the MAC of an interface that is the backup in an active-backup bond would be the MAC of the active member instead of its real MAC. * Fixed a bug in Convert->add_commas() where a passed in value of '0' returned an empty string. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
results => $results,
count => $count,
}});
foreach my $row (@{$results})
{
my $bond_uuid = defined $row->[0] ? $row->[0] : "";
my $bond_name = defined $row->[1] ? $row->[1] : "";
my $bond_mode = defined $row->[2] ? $row->[2] : "";
my $bond_mtu = defined $row->[3] ? $row->[3] : "";
* Renamed 'primary_slave' to 'primary_interface' for the bond table. * Got more work done on parsing the all_status.json (and fixing related bugs). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $bond_primary_interface = defined $row->[4] ? $row->[4] : "";
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $bond_primary_reselect = defined $row->[5] ? $row->[5] : "";
* Renamed bond_active_slave to bond_active_interface. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $bond_active_interface = defined $row->[6] ? $row->[6] : "";
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $bond_mii_polling_interval = defined $row->[7] ? $row->[7] : "";
my $bond_up_delay = defined $row->[8] ? $row->[8] : "";
my $bond_down_delay = defined $row->[9] ? $row->[9] : "";
my $bond_mac_address = defined $row->[10] ? $row->[10] : "";
my $bond_operational = defined $row->[11] ? $row->[11] : "";
* Added bonds -> bond_bridge_uuid to track which bridge, if any, that a bond is connected to. Updated Network->load_interfces() to record this. * Added missing foreign key references to the SQL schema. * Added support to tools/anvil-update-states to connect bonds to bridges, as appropriate. * Finished the logic in test.pl to pull the network data (with connections between bridges, bonds and interfaces) needed for the WebUI. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $bond_bridge_uuid = defined $row->[12] ? $row->[12] : "";
my $bridge_name = "";
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
bond_uuid => $bond_uuid,
bond_name => $bond_name,
bond_mode => $bond_mode,
bond_mtu => $bond_mtu,
* Renamed 'primary_slave' to 'primary_interface' for the bond table. * Got more work done on parsing the all_status.json (and fixing related bugs). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_primary_interface => $bond_primary_interface,
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_primary_reselect => $bond_primary_reselect,
* Renamed bond_active_slave to bond_active_interface. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_active_interface => $bond_active_interface,
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_mii_polling_interval => $bond_mii_polling_interval,
bond_up_delay => $bond_up_delay,
bond_down_delay => $bond_down_delay,
bond_mac_address => $bond_mac_address,
bond_operational => $bond_operational,
* Added bonds -> bond_bridge_uuid to track which bridge, if any, that a bond is connected to. Updated Network->load_interfces() to record this. * Added missing foreign key references to the SQL schema. * Added support to tools/anvil-update-states to connect bonds to bridges, as appropriate. * Finished the logic in test.pl to pull the network data (with connections between bridges, bonds and interfaces) needed for the WebUI. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_bridge_uuid => $bond_bridge_uuid,
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
* Added bonds -> bond_bridge_uuid to track which bridge, if any, that a bond is connected to. Updated Network->load_interfces() to record this. * Added missing foreign key references to the SQL schema. * Added support to tools/anvil-update-states to connect bonds to bridges, as appropriate. * Finished the logic in test.pl to pull the network data (with connections between bridges, bonds and interfaces) needed for the WebUI. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# If this bond is connected to a bridge, get the bridge name.
if (($bond_bridge_uuid) && (defined $anvil->data->{network}{$host}{bridge_uuid}{$bond_bridge_uuid}{name}))
{
$bridge_name = $anvil->data->{network}{$host}{bridge_uuid}{$bond_bridge_uuid}{name};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
bond_bridge_uuid => $bond_bridge_uuid,
bridge_name => $bridge_name,
}});
push @{$anvil->data->{network}{$host}{interface}{$bridge_name}{interfaces}}, $bond_name;
}
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# Record the bond_uuid -> name
$anvil->data->{network}{$host}{bond_uuid}{$bond_uuid}{name} = $bond_name;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"network::${host}::bond_uuid::${bond_uuid}::name" => $anvil->data->{network}{$host}{bond_uuid}{$bond_uuid}{name},
}});
# We'll initially load empty strings for what would be the IP information. Any interface with IPs will be populated when we call
$anvil->data->{network}{$host}{interface}{$bond_name}{uuid} = $bond_uuid;
$anvil->data->{network}{$host}{interface}{$bond_name}{mode} = $bond_mode;
$anvil->data->{network}{$host}{interface}{$bond_name}{mtu} = $bond_mtu;
* Renamed 'primary_slave' to 'primary_interface' for the bond table. * Got more work done on parsing the all_status.json (and fixing related bugs). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$bond_name}{primary_interface} = $bond_primary_interface;
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$bond_name}{primary_reselect} = $bond_primary_reselect;
* Renamed bond_active_slave to bond_active_interface. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$bond_name}{active_interface} = $bond_active_interface;
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$bond_name}{mii_polling_interval} = $bond_mii_polling_interval;
$anvil->data->{network}{$host}{interface}{$bond_name}{up_delay} = $bond_up_delay;
$anvil->data->{network}{$host}{interface}{$bond_name}{down_delay} = $bond_down_delay;
$anvil->data->{network}{$host}{interface}{$bond_name}{mac_address} = $bond_mac_address;
$anvil->data->{network}{$host}{interface}{$bond_name}{operational} = $bond_operational;
* Added bonds -> bond_bridge_uuid to track which bridge, if any, that a bond is connected to. Updated Network->load_interfces() to record this. * Added missing foreign key references to the SQL schema. * Added support to tools/anvil-update-states to connect bonds to bridges, as appropriate. * Finished the logic in test.pl to pull the network data (with connections between bridges, bonds and interfaces) needed for the WebUI. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$bond_name}{bridge_uuid} = $bond_bridge_uuid;
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$bond_name}{type} = "bond";
$anvil->data->{network}{$host}{interface}{$bond_name}{interfaces} = [];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"network::${host}::interface::${bond_name}::uuid" => $anvil->data->{network}{$host}{interface}{$bond_name}{uuid},
"network::${host}::interface::${bond_name}::mode" => $anvil->data->{network}{$host}{interface}{$bond_name}{mode},
"network::${host}::interface::${bond_name}::mtu" => $anvil->data->{network}{$host}{interface}{$bond_name}{mtu},
* Renamed 'primary_slave' to 'primary_interface' for the bond table. * Got more work done on parsing the all_status.json (and fixing related bugs). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${bond_name}::primary_interface" => $anvil->data->{network}{$host}{interface}{$bond_name}{primary_interface},
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${bond_name}::primary_reselect" => $anvil->data->{network}{$host}{interface}{$bond_name}{primary_reselect},
* Renamed bond_active_slave to bond_active_interface. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${bond_name}::active_interface" => $anvil->data->{network}{$host}{interface}{$bond_name}{active_interface},
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${bond_name}::mii_polling_interval" => $anvil->data->{network}{$host}{interface}{$bond_name}{mii_polling_interval},
"network::${host}::interface::${bond_name}::up_delay" => $anvil->data->{network}{$host}{interface}{$bond_name}{up_delay},
"network::${host}::interface::${bond_name}::down_delay" => $anvil->data->{network}{$host}{interface}{$bond_name}{down_delay},
"network::${host}::interface::${bond_name}::mac_address" => $anvil->data->{network}{$host}{interface}{$bond_name}{mac_address},
"network::${host}::interface::${bond_name}::operational" => $anvil->data->{network}{$host}{interface}{$bond_name}{operational},
* Added bonds -> bond_bridge_uuid to track which bridge, if any, that a bond is connected to. Updated Network->load_interfces() to record this. * Added missing foreign key references to the SQL schema. * Added support to tools/anvil-update-states to connect bonds to bridges, as appropriate. * Finished the logic in test.pl to pull the network data (with connections between bridges, bonds and interfaces) needed for the WebUI. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${bond_name}::bridge_uuid" => $anvil->data->{network}{$host}{interface}{$bond_name}{bridge},
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${bond_name}::type" => $anvil->data->{network}{$host}{interface}{$bond_name}{type},
}});
}
# The order will allow us to show the order in which the interfaces were changed, which the user can
# use to track interfaces as they unplug and plug cables back in.
my $order = 1;
$query = "
SELECT
network_interface_uuid,
network_interface_mac_address,
network_interface_name,
network_interface_speed,
network_interface_mtu,
network_interface_link_state,
network_interface_operational,
network_interface_duplex,
network_interface_medium,
network_interface_bond_uuid,
network_interface_bridge_uuid
FROM
network_interfaces
WHERE
network_interface_operational != 'DELETED'
AND
network_interface_host_uuid = ".$anvil->Database->quote($host_uuid)."
ORDER BY
modified_date DESC
;";
* Started work on caching network state change in tools/anvil-update-states. * Fixed a bug where ip_addresses could break resync when 2+ machines had the same IP (ie: 192.168.122.1). * Updated logging of DB transactions to show the DB host's IP instead of the UUID. * Updated Get->date_and_time to take a 'use_utc' parameter to return the time using GMT time instead of the host's TZ. * Updated anvil-daemon to periodically call tools/anvil-update-states. Also upadted anvil-daemon to delay daily jobs by 2 hours except for the dashboard with the highest sorted UUID to minimize dual runs of tasks that only need to run once per day per cluster. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0124", variables => { query => $query }});
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$results = $anvil->Database->query({query => $query, source => $THIS_FILE, line => __LINE__});
$count = @{$results};
* Added strings for making size suffixes translatable and updated Convert->bytes_to_human_readable to use them. * Fixed a bug in tools/anvil-update-states where the MAC of an interface that is the backup in an active-backup bond would be the MAC of the active member instead of its real MAC. * Fixed a bug in Convert->add_commas() where a passed in value of '0' returned an empty string. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
results => $results,
count => $count,
}});
* Created Network->get_company_from_mac() that converts a MAC address to the company name that owns it. * Added recording the last-change order for network interfaces in System->generate_state_json() so that the most recently unplugged and plugged back in interfaces can be tracked. * Worked out a faster way to ping scan subnets with nmap in striker-scan-network. Dropped average scan time from 35 minutes to 4~5 minutes for a /16 subnet. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $changed_order = 1;
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
foreach my $row (@{$results})
{
my $network_interface_uuid = defined $row->[0] ? $row->[0] : "";
my $network_interface_mac_address = defined $row->[1] ? $row->[1] : "";
my $network_interface_name = defined $row->[2] ? $row->[2] : "";
my $network_interface_speed = defined $row->[3] ? $row->[3] : "";
my $network_interface_mtu = defined $row->[4] ? $row->[4] : "";
my $network_interface_link_state = defined $row->[5] ? $row->[5] : "";
my $network_interface_operational = defined $row->[6] ? $row->[6] : "";
my $network_interface_duplex = defined $row->[7] ? $row->[7] : "";
my $network_interface_medium = defined $row->[8] ? $row->[8] : "";
my $network_interface_bond_uuid = defined $row->[9] ? $row->[9] : "";
my $network_interface_bridge_uuid = defined $row->[10] ? $row->[10] : "";
my $bond_name = "";
my $bridge_name = "";
* Updated Network->load_interfces() to only assign a 'changed_order' to real interfaces. * Fixed a bug in System->generate_state_json() where interfaces connected to a bridge were constantly having their 'network_interface_bond_uuid' cleared and reset. * Finished (for now) the jquery code to update the network interface list when preparing the network interface configuration of a new node or DR host. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $this_change_orger = 0;
if (($network_interface_name =~ /^virbr/) or ($network_interface_name =~ /^vnet/))
{
# This isn't a physical NIC, so it doesn't get a changed order
}
else
{
$this_change_orger = $changed_order++;
}
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (($network_interface_bond_uuid) && (defined $anvil->data->{network}{$host}{bond_uuid}{$network_interface_bond_uuid}{name}))
{
$bond_name = $anvil->data->{network}{$host}{bond_uuid}{$network_interface_bond_uuid}{name};
* Added strings for making size suffixes translatable and updated Convert->bytes_to_human_readable to use them. * Fixed a bug in tools/anvil-update-states where the MAC of an interface that is the backup in an active-backup bond would be the MAC of the active member instead of its real MAC. * Fixed a bug in Convert->add_commas() where a passed in value of '0' returned an empty string. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
network_interface_name => $network_interface_name,
bond_name => $bond_name,
}});
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
push @{$anvil->data->{network}{$host}{interface}{$bond_name}{interfaces}}, $network_interface_name;
}
if (($network_interface_bridge_uuid) && (defined $anvil->data->{network}{$host}{bridge_uuid}{$network_interface_bridge_uuid}{name}))
{
$bridge_name = $anvil->data->{network}{$host}{bridge_uuid}{$network_interface_bridge_uuid}{name};
* Added strings for making size suffixes translatable and updated Convert->bytes_to_human_readable to use them. * Fixed a bug in tools/anvil-update-states where the MAC of an interface that is the backup in an active-backup bond would be the MAC of the active member instead of its real MAC. * Fixed a bug in Convert->add_commas() where a passed in value of '0' returned an empty string. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
network_interface_name => $network_interface_name,
bridge_name => $bridge_name,
}});
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
push @{$anvil->data->{network}{$host}{interface}{$bridge_name}{interfaces}}, $network_interface_name;
}
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
network_interface_uuid => $network_interface_uuid,
network_interface_mac_address => $network_interface_mac_address,
network_interface_name => $network_interface_name,
network_interface_speed => $network_interface_speed,
network_interface_mtu => $network_interface_mtu,
network_interface_link_state => $network_interface_link_state,
network_interface_operational => $network_interface_operational,
network_interface_duplex => $network_interface_duplex,
network_interface_medium => $network_interface_medium,
network_interface_bond_uuid => $network_interface_bond_uuid,
network_interface_bridge_uuid => $network_interface_bridge_uuid,
bond_name => $bond_name,
* Updated Network->load_interfces() to only assign a 'changed_order' to real interfaces. * Fixed a bug in System->generate_state_json() where interfaces connected to a bridge were constantly having their 'network_interface_bond_uuid' cleared and reset. * Finished (for now) the jquery code to update the network interface list when preparing the network interface configuration of a new node or DR host. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
changed_order => $this_change_orger,
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
# We'll initially load empty strings for what would be the IP information. Any interface with IPs will be populated when we call
* Created Network->get_company_from_mac() that converts a MAC address to the company name that owns it. * Added recording the last-change order for network interfaces in System->generate_state_json() so that the most recently unplugged and plugged back in interfaces can be tracked. * Worked out a faster way to ping scan subnets with nmap in striker-scan-network. Dropped average scan time from 35 minutes to 4~5 minutes for a /16 subnet. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$network_interface_name}{uuid} = $network_interface_uuid;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{mac_address} = $network_interface_mac_address;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{speed} = $network_interface_speed;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{mtu} = $network_interface_mtu;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{link_state} = $network_interface_link_state;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{operational} = $network_interface_operational;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{duplex} = $network_interface_duplex;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{medium} = $network_interface_medium;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{bond_uuid} = $network_interface_bond_uuid;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{bond_name} = $bond_name;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{bridge_uuid} = $network_interface_bridge_uuid;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{bridge_name} = $bridge_name;
$anvil->data->{network}{$host}{interface}{$network_interface_name}{type} = "interface";
* Updated Network->load_interfces() to only assign a 'changed_order' to real interfaces. * Fixed a bug in System->generate_state_json() where interfaces connected to a bridge were constantly having their 'network_interface_bond_uuid' cleared and reset. * Finished (for now) the jquery code to update the network interface list when preparing the network interface configuration of a new node or DR host. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$network_interface_name}{changed_order} = $this_change_orger;
* Started work on caching network state change in tools/anvil-update-states. * Fixed a bug where ip_addresses could break resync when 2+ machines had the same IP (ie: 192.168.122.1). * Updated logging of DB transactions to show the DB host's IP instead of the UUID. * Updated Get->date_and_time to take a 'use_utc' parameter to return the time using GMT time instead of the host's TZ. * Updated anvil-daemon to periodically call tools/anvil-update-states. Also upadted anvil-daemon to delay daily jobs by 2 hours except for the dashboard with the highest sorted UUID to minimize dual runs of tasks that only need to run once per day per cluster. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Created Network->get_company_from_mac() that converts a MAC address to the company name that owns it. * Added recording the last-change order for network interfaces in System->generate_state_json() so that the most recently unplugged and plugged back in interfaces can be tracked. * Worked out a faster way to ping scan subnets with nmap in striker-scan-network. Dropped average scan time from 35 minutes to 4~5 minutes for a /16 subnet. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${network_interface_name}::uuid" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{uuid},
"network::${host}::interface::${network_interface_name}::mac_address" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{mac_address},
"network::${host}::interface::${network_interface_name}::speed" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{speed},
"network::${host}::interface::${network_interface_name}::mtu" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{mtu},
"network::${host}::interface::${network_interface_name}::link_state" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{link_state},
"network::${host}::interface::${network_interface_name}::operational" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{operational},
"network::${host}::interface::${network_interface_name}::duplex" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{duplex},
"network::${host}::interface::${network_interface_name}::medium" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{medium},
"network::${host}::interface::${network_interface_name}::bond_uuid" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{bond_uuid},
"network::${host}::interface::${network_interface_name}::bond_name" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{bond_name},
"network::${host}::interface::${network_interface_name}::bridge_uuid" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{bridge_uuid},
"network::${host}::interface::${network_interface_name}::bridge_name" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{bridge_name},
"network::${host}::interface::${network_interface_name}::type" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{type},
"network::${host}::interface::${network_interface_name}::changed_order" => $anvil->data->{network}{$host}{interface}{$network_interface_name}{changed_order},
* Removed the 'bridge_interfaces' table and related database methods. This was found to be duplicate, given that 'network_interfaces' has references to parent bonds and bridges. * Renamed 'bridges' -> 'bridge_mac' to 'bridge_mac_address' to be consstent with other MAC address column names. * Finished Network->load_interfces(). * Updated anvil-update-states to check for interfaces under bridges that are missing their 'network_interface_bridge_uuid' reference UUID. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
}
# Load the IPs
$anvil->Network->load_ips({
debug => $debug,
host_uuid => $host_uuid,
host => $host,
clear => 0,
});
* Updated the RPM spec file to generate '/etc/anvil/type.X' files to directly indicate the machine type. Updated System->get_host_type() to check for these files directly, falling back to parsing the host name if they don't exist. * Created Database->get_hosts_info() (though it's not at all finished) that will write out a unified JSON file contain all data known about all hosts/Anvil! systems. This will be later used to create the WebUI parts. * Also created, but also not finished, Network->load_interfces() that will work sort of like ->load_ups, but include all interfaces regardless of if they have an IP or not. * Fixed a bug where the new bridge_interface_note parameter didn't exist in the Database->insert_or_update_bridge_interfaces() method. * Updated anvil-update-states() to only write out the JSON/XML files if it's running on a dashboard. For nodes and DR hosts, it just needs to update the database. * Created a new hook in anvil-daemon that will call tasks on a machine that is configured. * As per RHEL 8.1 release notes, changed the package 'dnf-utils' to 'yum-utils' in the packages to load for install target repos. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return(0);
}
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 load_ips
This method loads and stores the same data as the C<< get_ips >> method, but does so by loading data from the database, instead of collecting it directly from the host. As such, it can also be used by C<< find_matches >>.
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
C<< Note >>: IP addresses that have been deleted will be marked so by C<< ip >> being set to C<< DELETED >>.
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
The loaded data will be stored as:
* Finished getting tools/striker-auto-initialize-all to merge the built Strikers. * Fixed a bug in Remote->call() where the output of the call not ending in a newline wasn't having the return code parsed off properly. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
* C<< network::<host>::interface::<iface_name>::ip >> - If an IP address is set
* C<< network::<host>::interface::<iface_name>::subnet_mask >> - If an IP is set
* C<< network::<host>::interface::<iface_name>::mac >> - Always set.
* C<< network::<host>::interface::<iface_name>::default_gateway >> = C<< 0 >> if not the default gateway, C<< 1 >> if so.
* C<< network::<host>::interface::<iface_name>::gateway >> = If the default gateway, this is the gateway IP address.
* C<< network::<host>::interface::<iface_name>::dns >> = If the default gateway, this is the comma-separated list of active DNS servers.
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
Parameters;
* Updated the RPM spec file to generate '/etc/anvil/type.X' files to directly indicate the machine type. Updated System->get_host_type() to check for these files directly, falling back to parsing the host name if they don't exist. * Created Database->get_hosts_info() (though it's not at all finished) that will write out a unified JSON file contain all data known about all hosts/Anvil! systems. This will be later used to create the WebUI parts. * Also created, but also not finished, Network->load_interfces() that will work sort of like ->load_ups, but include all interfaces regardless of if they have an IP or not. * Fixed a bug where the new bridge_interface_note parameter didn't exist in the Database->insert_or_update_bridge_interfaces() method. * Updated anvil-update-states() to only write out the JSON/XML files if it's running on a dashboard. For nodes and DR hosts, it just needs to update the database. * Created a new hook in anvil-daemon that will call tasks on a machine that is configured. * As per RHEL 8.1 release notes, changed the package 'dnf-utils' to 'yum-utils' in the packages to load for install target repos. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head3 clear (optional, default '1')
* Finished getting tools/striker-auto-initialize-all to merge the built Strikers. * Fixed a bug in Remote->call() where the output of the call not ending in a newline wasn't having the return code parsed off properly. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
When set, any previously known information is cleared. Specifically, the C<< network::<host>> >> hash is deleted prior to the load. To prevent this, set this to C<< 0 >>.
* Updated the RPM spec file to generate '/etc/anvil/type.X' files to directly indicate the machine type. Updated System->get_host_type() to check for these files directly, falling back to parsing the host name if they don't exist. * Created Database->get_hosts_info() (though it's not at all finished) that will write out a unified JSON file contain all data known about all hosts/Anvil! systems. This will be later used to create the WebUI parts. * Also created, but also not finished, Network->load_interfces() that will work sort of like ->load_ups, but include all interfaces regardless of if they have an IP or not. * Fixed a bug where the new bridge_interface_note parameter didn't exist in the Database->insert_or_update_bridge_interfaces() method. * Updated anvil-update-states() to only write out the JSON/XML files if it's running on a dashboard. For nodes and DR hosts, it just needs to update the database. * Created a new hook in anvil-daemon that will call tasks on a machine that is configured. * As per RHEL 8.1 release notes, changed the package 'dnf-utils' to 'yum-utils' in the packages to load for install target repos. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head3 host (optional, default is 'host_uuid' value)
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Finished getting tools/striker-auto-initialize-all to merge the built Strikers. * Fixed a bug in Remote->call() where the output of the call not ending in a newline wasn't having the return code parsed off properly. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
This is the optional C<< host >> string to use in the hash where the data is stored.
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head3 host_uuid (optional, default 'sys::host_uuid')
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
This is the C<< host_uuid >> of the hosts whose IP and interface data that you want to load. The default is to load the local machine's data.
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=cut
sub load_ips
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
* Updated all methods to add (or fix) logging the method entry. * More work done on Email->send_email() to, well, actually send email (which it isn't doing yet, but it's close). * Updated Words->key() to include the bad key name when no entry for the requested key exists in the words.xml file. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->load_ips()" }});
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Updated the RPM spec file to generate '/etc/anvil/type.X' files to directly indicate the machine type. Updated System->get_host_type() to check for these files directly, falling back to parsing the host name if they don't exist. * Created Database->get_hosts_info() (though it's not at all finished) that will write out a unified JSON file contain all data known about all hosts/Anvil! systems. This will be later used to create the WebUI parts. * Also created, but also not finished, Network->load_interfces() that will work sort of like ->load_ups, but include all interfaces regardless of if they have an IP or not. * Fixed a bug where the new bridge_interface_note parameter didn't exist in the Database->insert_or_update_bridge_interfaces() method. * Updated anvil-update-states() to only write out the JSON/XML files if it's running on a dashboard. For nodes and DR hosts, it just needs to update the database. * Created a new hook in anvil-daemon that will call tasks on a machine that is configured. * As per RHEL 8.1 release notes, changed the package 'dnf-utils' to 'yum-utils' in the packages to load for install target repos. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $clear = defined $parameter->{clear} ? $parameter->{clear} : 1;
* THe get_cpu endpoint was completed. * The get_mmeory endpoint was completed. * The get_replicated_storage endpoint was completed, though it requires testing and likely has issues. To prepare for the get_status endpoint work, I needed to update ScanCore and modules to track the host_status. This commit contains the work needed for this. * Updated ScanCore->post_scan_analysis_striker() to use configured fence devices (except PDUs) to check if a target host is off or on, in there is no host_ipmi interface. In all cases, if a machine can be confirmed on or off, the host_status is now updated. * To support the above fence based power checks, updated scan-cluster to store the on-disk CIB in the new scan_cluster -> scan_cluster_cib colume. * Updated ScanCore->parse_cib() to map stonith primitive IDs to fence agents. Updated ->parse_crm_mon() to not call if the executable doesn't exist to avoid unhelpful error messages in the logs when called from a Striker. * Update DRBD->gather_data() to get the size data from /sys/block/drbd<minor>/size' x '/sys/block/drbd<minor>/queue/logical_block_size so it works when a device is Secondary (and can't be promoted). * Updated Database->get_hosts_info() to record the short host name as well as the stored host name. Created ->update_host_status() as a wrapper to ->insert_or_update_hosts() that only updates the host status. * Updated anvil-join-anvil to disabled ksm and ksmtuned daemons. * Updated scancore and anvil-daemon to set the host_status to 'online' on startup. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
my $host_uuid = defined $parameter->{host_uuid} ? $parameter->{host_uuid} : $anvil->Get->host_uuid;
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $host = defined $parameter->{host} ? $parameter->{host} : "";
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Updated the RPM spec file to generate '/etc/anvil/type.X' files to directly indicate the machine type. Updated System->get_host_type() to check for these files directly, falling back to parsing the host name if they don't exist. * Created Database->get_hosts_info() (though it's not at all finished) that will write out a unified JSON file contain all data known about all hosts/Anvil! systems. This will be later used to create the WebUI parts. * Also created, but also not finished, Network->load_interfces() that will work sort of like ->load_ups, but include all interfaces regardless of if they have an IP or not. * Fixed a bug where the new bridge_interface_note parameter didn't exist in the Database->insert_or_update_bridge_interfaces() method. * Updated anvil-update-states() to only write out the JSON/XML files if it's running on a dashboard. For nodes and DR hosts, it just needs to update the database. * Created a new hook in anvil-daemon that will call tasks on a machine that is configured. * As per RHEL 8.1 release notes, changed the package 'dnf-utils' to 'yum-utils' in the packages to load for install target repos. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
clear => $clear,
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
host => $host,
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
host_uuid => $host_uuid,
}});
if (not $host_uuid)
{
* Added gateway support to install manigest creation step 2. * Finished sanity checking install manifest step2. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->load_ips()", parameter => "ip" }});
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return("");
}
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (not $host)
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$host = $host_uuid;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { host => $host }});
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
* Updated the RPM spec file to generate '/etc/anvil/type.X' files to directly indicate the machine type. Updated System->get_host_type() to check for these files directly, falling back to parsing the host name if they don't exist. * Created Database->get_hosts_info() (though it's not at all finished) that will write out a unified JSON file contain all data known about all hosts/Anvil! systems. This will be later used to create the WebUI parts. * Also created, but also not finished, Network->load_interfces() that will work sort of like ->load_ups, but include all interfaces regardless of if they have an IP or not. * Fixed a bug where the new bridge_interface_note parameter didn't exist in the Database->insert_or_update_bridge_interfaces() method. * Updated anvil-update-states() to only write out the JSON/XML files if it's running on a dashboard. For nodes and DR hosts, it just needs to update the database. * Created a new hook in anvil-daemon that will call tasks on a machine that is configured. * As per RHEL 8.1 release notes, changed the package 'dnf-utils' to 'yum-utils' in the packages to load for install target repos. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (($clear) && (exists $anvil->data->{network}{$host}))
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
delete $anvil->data->{network}{$host};
}
# Read in all IPs, so that we know which to remove.
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $query = "
SELECT
ip_address_address,
ip_address_subnet_mask,
ip_address_gateway,
ip_address_default_gateway,
ip_address_dns,
ip_address_on_type,
ip_address_on_uuid
FROM
ip_addresses
WHERE
* Fixed the order or table creations in anvil.sql (as well as fixed a missing comma) * Fixed / added 'delete' parameters for Database->insert_or_update_bridges(), ->insert_or_update_bonds(), ->insert_or_update_ip_addresses() and ->insert_or_update_network_interfaces(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
ip_address_host_uuid = ".$anvil->Database->quote($host_uuid)."
AND
ip_address_note != 'DELETED'
* Finished the jquery/css stuff for showing the list of hosts that can have their network configured. * Fixed unclear error logging in Network->find_matches(). * Updated System->generate_state_json() Striker->parse_all_status_json() to determine if another machine can be reached from the local dashboard. If it can be reached, the first matching interface and IP are recorded. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
;";
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { query => $query }});
my $results = $anvil->Database->query({query => $query, source => $THIS_FILE, line => __LINE__});
my $count = @{$results};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
results => $results,
count => $count,
}});
foreach my $row (@{$results})
{
my $ip_address_address = $row->[0];
my $ip_address_subnet_mask = $row->[1];
my $ip_address_gateway = $row->[2];
my $ip_address_default_gateway = $row->[3];
my $ip_address_dns = $row->[4];
my $ip_address_on_type = $row->[5];
my $ip_address_on_uuid = $row->[6];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
ip_address_address => $ip_address_address,
ip_address_subnet_mask => $ip_address_subnet_mask,
ip_address_gateway => $ip_address_gateway,
ip_address_default_gateway => $ip_address_default_gateway,
ip_address_dns => $ip_address_dns,
ip_address_on_type => $ip_address_on_type,
ip_address_on_uuid => $ip_address_on_uuid,
}});
my $interface_name = "";
my $interface_mac = "";
if ($ip_address_on_type eq "interface")
{
my $query = "
SELECT
network_interface_name,
network_interface_mac_address
FROM
network_interfaces
WHERE
* Fixed the order or table creations in anvil.sql (as well as fixed a missing comma) * Fixed / added 'delete' parameters for Database->insert_or_update_bridges(), ->insert_or_update_bonds(), ->insert_or_update_ip_addresses() and ->insert_or_update_network_interfaces(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
network_interface_uuid = ".$anvil->Database->quote($ip_address_on_uuid)."
AND
network_interface_operational != 'DELETED'
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
;";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { query => $query }});
my $results = $anvil->Database->query({query => $query, source => $THIS_FILE, line => __LINE__});
my $count = @{$results};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
results => $results,
count => $count,
}});
* Fixed a bug in Database->disconnect() where the database idenitification number wasn't being removed, so connecting again triggered the duplicate DB connection check. * Fixed a bug in Tools->_set_defaults where the order the tables were sync'ed it caused primary/foreign keys would trigger DB errors when resync'ing in some cases. * Created Database->log_connections to make it easier to log which databases are actively in use and other data about the connections. * Fixed bugs in striker-manage-peers that (partly because of the above bugs) failed to connect to new peers properly. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
next if not $count;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$interface_name = $results->[0]->[0];
$interface_mac = $results->[0]->[1];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
interface_name => $interface_name,
interface_mac => $interface_mac,
}});
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Changed a bunch more variables to standardize on 'mac_address' instead of 'mac'. * Added ' --best --allowerasing' to the dnf call in tools/anvil-update-system (found it was needed when 'yum-utils' replaced 'dnf-utils' in RHEL 8.1 release). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{mac_address} = $interface_mac;
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{ip} = $ip_address_address;
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{subnet_mask} = $ip_address_subnet_mask;
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{default_gateway} = $ip_address_default_gateway;
$anvil->data->{network}{$host}{interface}{$interface_name}{gateway} = $ip_address_gateway;
$anvil->data->{network}{$host}{interface}{$interface_name}{dns} = $ip_address_dns;
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{type} = $ip_address_on_type;
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Changed a bunch more variables to standardize on 'mac_address' instead of 'mac'. * Added ' --best --allowerasing' to the dnf call in tools/anvil-update-system (found it was needed when 'yum-utils' replaced 'dnf-utils' in RHEL 8.1 release). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::mac_address" => $anvil->data->{network}{$host}{interface}{$interface_name}{mac_address},
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::ip" => $anvil->data->{network}{$host}{interface}{$interface_name}{ip},
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::subnet_mask" => $anvil->data->{network}{$host}{interface}{$interface_name}{subnet_mask},
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::default_gateway" => $anvil->data->{network}{$host}{interface}{$interface_name}{default_gateway},
"network::${host}::interface::${interface_name}::gateway" => $anvil->data->{network}{$host}{interface}{$interface_name}{gateway},
"network::${host}::interface::${interface_name}::dns" => $anvil->data->{network}{$host}{interface}{$interface_name}{dns},
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::type" => $anvil->data->{network}{$host}{interface}{$interface_name}{type},
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
elsif ($ip_address_on_type eq "bond")
{
my $query = "
SELECT
bond_name,
bond_mac_address
FROM
bonds
WHERE
* Fixed the order or table creations in anvil.sql (as well as fixed a missing comma) * Fixed / added 'delete' parameters for Database->insert_or_update_bridges(), ->insert_or_update_bonds(), ->insert_or_update_ip_addresses() and ->insert_or_update_network_interfaces(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bond_uuid = ".$anvil->Database->quote($ip_address_on_uuid)."
AND
bond_operational != 'DELETED'
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
;";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { query => $query }});
my $results = $anvil->Database->query({query => $query, source => $THIS_FILE, line => __LINE__});
my $count = @{$results};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
results => $results,
count => $count,
}});
* Fixed a bug in Database->disconnect() where the database idenitification number wasn't being removed, so connecting again triggered the duplicate DB connection check. * Fixed a bug in Tools->_set_defaults where the order the tables were sync'ed it caused primary/foreign keys would trigger DB errors when resync'ing in some cases. * Created Database->log_connections to make it easier to log which databases are actively in use and other data about the connections. * Fixed bugs in striker-manage-peers that (partly because of the above bugs) failed to connect to new peers properly. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
next if not $count;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$interface_name = $results->[0]->[0];
$interface_mac = $results->[0]->[1];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
interface_name => $interface_name,
interface_mac => $interface_mac,
}});
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Changed a bunch more variables to standardize on 'mac_address' instead of 'mac'. * Added ' --best --allowerasing' to the dnf call in tools/anvil-update-system (found it was needed when 'yum-utils' replaced 'dnf-utils' in RHEL 8.1 release). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{mac_address} = $interface_mac;
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{ip} = $ip_address_address;
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{subnet_mask} = $ip_address_subnet_mask;
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{default_gateway} = $ip_address_default_gateway;
$anvil->data->{network}{$host}{interface}{$interface_name}{gateway} = $ip_address_gateway;
$anvil->data->{network}{$host}{interface}{$interface_name}{dns} = $ip_address_dns;
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{type} = $ip_address_on_type;
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Changed a bunch more variables to standardize on 'mac_address' instead of 'mac'. * Added ' --best --allowerasing' to the dnf call in tools/anvil-update-system (found it was needed when 'yum-utils' replaced 'dnf-utils' in RHEL 8.1 release). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::mac_address" => $anvil->data->{network}{$host}{interface}{$interface_name}{mac_address},
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::ip" => $anvil->data->{network}{$host}{interface}{$interface_name}{ip},
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::subnet_mask" => $anvil->data->{network}{$host}{interface}{$interface_name}{subnet_mask},
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::default_gateway" => $anvil->data->{network}{$host}{interface}{$interface_name}{default_gateway},
"network::${host}::interface::${interface_name}::gateway" => $anvil->data->{network}{$host}{interface}{$interface_name}{gateway},
"network::${host}::interface::${interface_name}::dns" => $anvil->data->{network}{$host}{interface}{$interface_name}{dns},
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::type" => $anvil->data->{network}{$host}{interface}{$interface_name}{type},
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
elsif ($ip_address_on_type eq "bridge")
{
my $query = "
SELECT
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bridge_name,
bridge_mac_address
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
FROM
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bridges
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
WHERE
* Fixed the order or table creations in anvil.sql (as well as fixed a missing comma) * Fixed / added 'delete' parameters for Database->insert_or_update_bridges(), ->insert_or_update_bonds(), ->insert_or_update_ip_addresses() and ->insert_or_update_network_interfaces(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
bridge_uuid = ".$anvil->Database->quote($ip_address_on_uuid)."
AND
bridge_id != 'DELETED'
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
;";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { query => $query }});
my $results = $anvil->Database->query({query => $query, source => $THIS_FILE, line => __LINE__});
my $count = @{$results};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
results => $results,
count => $count,
}});
* Fixed a bug in Database->disconnect() where the database idenitification number wasn't being removed, so connecting again triggered the duplicate DB connection check. * Fixed a bug in Tools->_set_defaults where the order the tables were sync'ed it caused primary/foreign keys would trigger DB errors when resync'ing in some cases. * Created Database->log_connections to make it easier to log which databases are actively in use and other data about the connections. * Fixed bugs in striker-manage-peers that (partly because of the above bugs) failed to connect to new peers properly. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
next if not $count;
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$interface_name = $results->[0]->[0];
$interface_mac = $results->[0]->[1];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
interface_name => $interface_name,
interface_mac => $interface_mac,
}});
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Changed a bunch more variables to standardize on 'mac_address' instead of 'mac'. * Added ' --best --allowerasing' to the dnf call in tools/anvil-update-system (found it was needed when 'yum-utils' replaced 'dnf-utils' in RHEL 8.1 release). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{mac_address} = $interface_mac;
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{ip} = $ip_address_address;
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{subnet_mask} = $ip_address_subnet_mask;
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{default_gateway} = $ip_address_default_gateway;
$anvil->data->{network}{$host}{interface}{$interface_name}{gateway} = $ip_address_gateway;
$anvil->data->{network}{$host}{interface}{$interface_name}{dns} = $ip_address_dns;
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface_name}{type} = $ip_address_on_type;
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Changed a bunch more variables to standardize on 'mac_address' instead of 'mac'. * Added ' --best --allowerasing' to the dnf call in tools/anvil-update-system (found it was needed when 'yum-utils' replaced 'dnf-utils' in RHEL 8.1 release). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::mac_address" => $anvil->data->{network}{$host}{interface}{$interface_name}{mac_address},
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::ip" => $anvil->data->{network}{$host}{interface}{$interface_name}{ip},
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::subnet_mask" => $anvil->data->{network}{$host}{interface}{$interface_name}{subnet_mask},
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::default_gateway" => $anvil->data->{network}{$host}{interface}{$interface_name}{default_gateway},
"network::${host}::interface::${interface_name}::gateway" => $anvil->data->{network}{$host}{interface}{$interface_name}{gateway},
"network::${host}::interface::${interface_name}::dns" => $anvil->data->{network}{$host}{interface}{$interface_name}{dns},
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface_name}::type" => $anvil->data->{network}{$host}{interface}{$interface_name}{type},
* Finished Network->load_ips(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
* Created Network->download() to handle downloading a file on the local system. Created ->bridge_info() to parse 'bridge' output. Created ->load_ips() to load IP address information from the database (as opposed to ->get_ips() which queries a system). * Created Database->insert_or_update_bridge_interfaces() to handle updating the new bridge_interfaces database table that records which network interfaces are connected to which bridges. * Added 'bridge_mac' and 'bridge_mtu' to the 'bridges' table. * Started Server->map_network which will, eventually, try to map MAC addresses to IPs and record server -> vnetX -> bridge data. Made getting a server status target-dependent. * Worked on anvil-update-states to parse and record bridge data. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
}
return(0);
}
* Created Network->get_company_from_mac() that converts a MAC address to the company name that owns it. * Added recording the last-change order for network interfaces in System->generate_state_json() so that the most recently unplugged and plugged back in interfaces can be tracked. * Worked out a faster way to ping scan subnets with nmap in striker-scan-network. Dropped average scan time from 35 minutes to 4~5 minutes for a /16 subnet. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 get_company_from_mac
This takes a MAC address (or the first six bytes) and returns the company that owns the OUI. If the company name is not found, an expty string is returned.
Parameters;
=head3 mac (required)
This is the first six bytes of the mac address, C<< xx:xx:xx >> format, being searched for.
=cut
sub get_company_from_mac
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->get_company_from_mac()" }});
my $mac = defined $parameter->{mac} ? lc($parameter->{mac}) : "";
my $company = "";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
mac => $mac,
}});
if (not $mac)
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->get_company_from_mac()", parameter => "mac_prefix" }});
return("");
}
# Have I already looked this one up?
if ($anvil->data->{cache}{mac_to_oui}{$mac})
{
# Yup, no need to process.
return($anvil->data->{cache}{mac_to_oui}{$mac});
}
* Renamed all Validate->is_X to Validate->X. Also created Validate->ipv6() to validate IPv6 addresses using Data::Validate::IP (and added it as a requirement to the .spec base RPM). * Added the fix from the last commit for System->call to handle returned data without an ending newline to Remote->call. * Got more work done on System->update_hosts(). It's able to add new hosts, but misses the short and FQDN host names. Need to fix that and the verify existing / manual entries aren't molested. Signed-off-by: digimer <digimer@pulsar.alteeve.com>
4 years ago
my $valid_mac = $anvil->Validate->mac({mac => $mac});
* Created Network->get_company_from_mac() that converts a MAC address to the company name that owns it. * Added recording the last-change order for network interfaces in System->generate_state_json() so that the most recently unplugged and plugged back in interfaces can be tracked. * Worked out a faster way to ping scan subnets with nmap in striker-scan-network. Dropped average scan time from 35 minutes to 4~5 minutes for a /16 subnet. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { mac => $mac }});
if ($valid_mac)
{
# Strip the first six bytes.
$mac = ($mac =~ /^([0-9a-f]{2}[:-][0-9a-f]{2}[:-][0-9a-f]{2})/i)[0];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { mac => $mac }});
}
elsif ($mac !~ /[0-9a-f]{2}[:-][0-9a-f]{2}[:-][0-9a-f]{2}/i)
{
# Bad format
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "error_0104", variables => { mac => $mac }});
return("");
}
my $query = "SELECT oui_company_name FROM oui WHERE oui_mac_prefix = ".$anvil->Database->quote(lc($mac)).";";
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0124", variables => { query => $query }});
my $results = $anvil->Database->query({query => $query, source => $THIS_FILE, line => __LINE__});
my $count = @{$results};
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
results => $results,
count => $count,
}});
if ($count)
{
$company = $results->[0]->[0];
$anvil->data->{cache}{mac_to_oui}{$mac} = $company;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { company => $company }});
}
return($company);
}
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 get_ips
This method checks the local system for interfaces and stores them in:
* C<< network::<target>::interface::<iface_name>::ip >> - If an IP address is set
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* C<< network::<target>::interface::<iface_name>::subnet_mask >> - If an IP is set
* Updated Jobs->get_job_details() to use --job-uuid switch or, failing that, look for an incomplete on this host with the same command as the calling program. * Got anvil-join-anvil to the point that it reworks the network configs, updates MTUs and configured NTP. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
* C<< network::<target>::interface::<iface_name>::mac_address >> - Always set.
* C<< network::<target>::interface::<iface_name>::mtu >> - Always set.
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* C<< network::<target>::interface::<iface_name>::default_gateway >> = C<< 0 >> if not the default gateway, C<< 1 >> if so.
* C<< network::<target>::interface::<iface_name>::gateway >> = If the default gateway, this is the gateway IP address.
* C<< network::<target>::interface::<iface_name>::dns >> = If the default gateway, this is the comma-separated list of active DNS servers.
* Updated Network->get_ips() to (again) record the MAC addresses and to create a MAC to interface name lookup hash. This was (accidentally?) removed back when the ->get_ips() was changed to store the data in a host-specific hash. * Updated tools/anvil-configure-host to use the new MAC to interface name lookup hash. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
To make it convenient to translate a MAC address into interface names, this hash is also stored;
* C<< network::<target>::mac_address::<mac_address>::interface = Interface name.
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
When called without a C<< target >>, C<< local >> is used.
* Fixed a comment bug in Network->reconfigure_network() indicating that MAC lookup was using the wrong hash key. * Fixed a couple more bugs in tools/anvil-configure-host, getting it now to the point where it writes out the network config files. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
To aid in look-up by MAC address, C<< network::mac_address::<mac_address>::iface >> is also set. Note that this is not target-dependent.
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
Parameters;
=head3 password (optional)
If C<< target >> is set, this is the password used to log into the remote system as the C<< remote_user >>. If it is not set, an attempt to connect without a password will be made (though this will usually fail).
=head3 port (optional, default 22)
If C<< target >> is set, this is the TCP port number used to connect to the remote machine.
=head3 remote_user (optional)
If C<< target >> is set, this is the user account that will be used when connecting to the remote system.
=head3 target (optional)
If set, the file will be read from the target machine. This must be either an IP address or a resolvable host name.
The file will be copied to the local system using C<< $anvil->Storage->rsync() >> and stored in C<< /tmp/<file_path_and_name>.<target> >>. if C<< cache >> is set, the file will be preserved locally. Otherwise it will be deleted once it has been read into memory.
B<< Note >>: the temporary file will be prefixed with the path to the file name, with the C<< / >> converted to C<< _ >>.
=cut
sub get_ips
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->get_ips()" }});
my $password = defined $parameter->{password} ? $parameter->{password} : "";
my $port = defined $parameter->{port} ? $parameter->{port} : 22;
my $remote_user = defined $parameter->{remote_user} ? $parameter->{remote_user} : "root";
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $target = defined $parameter->{target} ? $parameter->{target} : "";
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
password => $anvil->Log->is_secure($password),
port => $port,
remote_user => $remote_user,
target => $target,
}});
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# This is used in the hash reference when storing the data.
* Moved the '_host_name', '_short_host_name', and '_domain_name' private methods in Tools.pm over to Get.pm (removing the leading '_' in the method names). * Created 'Cluster->which_node' that returns 'node1' or 'node2' to indicate which node a host is. * Continued working on scan_cluster; decided to make it not host-dependent. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
my $host = $target ? $target : $anvil->Get->short_host_name();
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { host => $host }});
* Fixed tools/anvil-update-states so that it properly removed ip_addresses no longer assigned to a host. Also merged 'network::interfaces::by_name::${interface}' with 'network::local::interface::${interface}' for storing discovered interfaces.' * Added 'ip_address_note' to the 'ip_addresses' table as there was no column convenient for flagging as DELETEd. * Added 'uuid' to Database->insert_or_update_file_locations() and ->insert_or_update_files(), and actually used it in all ->inser_or_update_X() methods. * Added 'delete' as a parameter to Database->insert_or_update_ip_addresses() to allow simple deletion of a referenced IP address. * Addressed a few 'undefined variable' errors. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (exists $anvil->data->{network}{$host})
{
delete $anvil->data->{network}{$host};
}
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# Reading locally or remote?
my $in_iface = "";
my $shell_call = $anvil->data->{path}{exe}{ip}." addr list";
my $output = "";
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $is_local = $anvil->Network->is_local({host => $target});
if ($is_local)
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Local call.
($output, my $return_code) = $anvil->System->call({debug => $debug, shell_call => $shell_call});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:return_code' => $return_code,
}});
}
else
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Remote call
($output, my $error, my $return_code) = $anvil->Remote->call({
debug => $debug,
shell_call => $shell_call,
target => $target,
user => $remote_user,
password => $password,
remote_user => $remote_user,
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:error' => $error,
's3:return_code' => $return_code,
}});
}
foreach my $line (split/\n/, $output)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
if ($line =~ /^\d+: (.*?): /)
{
$in_iface = $1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { in_iface => $in_iface }});
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$in_iface}{ip} = "" if not defined $anvil->data->{network}{$host}{interface}{$in_iface}{ip};
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$in_iface}{subnet_mask} = "" if not defined $anvil->data->{network}{$host}{interface}{$in_iface}{subnet_mask};
* Changed a bunch more variables to standardize on 'mac_address' instead of 'mac'. * Added ' --best --allowerasing' to the dnf call in tools/anvil-update-system (found it was needed when 'yum-utils' replaced 'dnf-utils' in RHEL 8.1 release). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$in_iface}{mac_address} = "" if not defined $anvil->data->{network}{$host}{interface}{$in_iface}{mac_address};
* Updated Jobs->get_job_details() to use --job-uuid switch or, failing that, look for an incomplete on this host with the same command as the calling program. * Got anvil-join-anvil to the point that it reworks the network configs, updates MTUs and configured NTP. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
$anvil->data->{network}{$host}{interface}{$in_iface}{mtu} = 0 if not defined $anvil->data->{network}{$host}{interface}{$in_iface}{mtu};
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$in_iface}{default_gateway} = 0 if not defined $anvil->data->{network}{$host}{interface}{$in_iface}{default_gateway};
$anvil->data->{network}{$host}{interface}{$in_iface}{gateway} = "" if not defined $anvil->data->{network}{$host}{interface}{$in_iface}{gateway};
$anvil->data->{network}{$host}{interface}{$in_iface}{dns} = "" if not defined $anvil->data->{network}{$host}{interface}{$in_iface}{dns};
* Fixed a bug in anvil-daemon where, when an anvil-manage-power reboot run had triggered a reboot, anvil-daemon didn't set the job_progress to '100', causing constant reboots. Also fixed a bug where the log level was hard-set to '1' instead of '2' needed during debugging. * Updated Jobs->get_job_uuid() to accept the new 'incomplete' parameter that, when set, will look for jobs whose progress is > 1 and < 100. * Updated ScanCore-agent_startup() to take the new 'no_db_ok' parameter which returns with '0' if no DB is available and that parameter is set to '1'. * Fixed a logging bug in 'anvil-join-anvil'. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->data->{network}{$host}{interface}{$in_iface}{tx_bytes} = 0 if not defined $anvil->data->{network}{$host}{interface}{$in_iface}{tx_bytes};
$anvil->data->{network}{$host}{interface}{$in_iface}{rx_bytes} = 0 if not defined $anvil->data->{network}{$host}{interface}{$in_iface}{rx_bytes};
* Made more progress on tools/striker-auto-initialize-all, now to the point where it loads the variables needed to initialize Striker dashboard. * Cleaned up / added some logging in various locations. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"network::${host}::interface::${in_iface}::ip" => $anvil->data->{network}{$host}{interface}{$in_iface}{ip},
"network::${host}::interface::${in_iface}::subnet_mask" => $anvil->data->{network}{$host}{interface}{$in_iface}{subnet_mask},
"network::${host}::interface::${in_iface}::mac_address" => $anvil->data->{network}{$host}{interface}{$in_iface}{mac_address},
"network::${host}::interface::${in_iface}::mtu" => $anvil->data->{network}{$host}{interface}{$in_iface}{mtu},
"network::${host}::interface::${in_iface}::default_gateway" => $anvil->data->{network}{$host}{interface}{$in_iface}{default_gateway},
"network::${host}::interface::${in_iface}::gateway" => $anvil->data->{network}{$host}{interface}{$in_iface}{gateway},
"network::${host}::interface::${in_iface}::dns" => $anvil->data->{network}{$host}{interface}{$in_iface}{dns},
}});
* Fixed a bug in anvil-daemon where, when an anvil-manage-power reboot run had triggered a reboot, anvil-daemon didn't set the job_progress to '100', causing constant reboots. Also fixed a bug where the log level was hard-set to '1' instead of '2' needed during debugging. * Updated Jobs->get_job_uuid() to accept the new 'incomplete' parameter that, when set, will look for jobs whose progress is > 1 and < 100. * Updated ScanCore-agent_startup() to take the new 'no_db_ok' parameter which returns with '0' if no DB is available and that parameter is set to '1'. * Fixed a logging bug in 'anvil-join-anvil'. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
if ($in_iface ne "lo")
{
# Read the read and write bytes.
my $read_bytes = 0;
my $write_bytes = 0;
my $shell_call = "
if [ -e '/sys/class/net/".$in_iface."/statistics/rx_bytes' ];
then
echo -n 'rx:';
cat /sys/class/net/".$in_iface."/statistics/rx_bytes;
echo -n 'tx:';
cat /sys/class/net/".$in_iface."/statistics/tx_bytes;
else
echo 'rx:0';
echo 'tx:0';
fi";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { shell_call => $shell_call }});
my $transmit_sizes = "";
if ($is_local)
{
# Local call.
($transmit_sizes, my $return_code) = $anvil->System->call({debug => $debug, shell_call => $shell_call});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:transmit_sizes' => $transmit_sizes,
's2:return_code' => $return_code,
}});
}
else
{
# Remote call
($transmit_sizes, my $error, my $return_code) = $anvil->Remote->call({
debug => $debug,
shell_call => $shell_call,
target => $target,
user => $remote_user,
password => $password,
remote_user => $remote_user,
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:transmit_sizes' => $transmit_sizes,
's2:error' => $error,
's3:return_code' => $return_code,
}});
}
foreach my $line (split/\n/, $transmit_sizes)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
if ($line =~ /rx:(\d+)/)
{
$anvil->data->{network}{$host}{interface}{$in_iface}{rx_bytes} = $1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"network::${host}::interface::${in_iface}::rx_bytes" => $anvil->data->{network}{$host}{interface}{$in_iface}{rx_bytes}." (".$anvil->Convert->bytes_to_human_readable({'bytes' => $anvil->data->{network}{$host}{interface}{$in_iface}{rx_bytes}}).")",
}});
}
if ($line =~ /tx:(\d+)/)
{
$anvil->data->{network}{$host}{interface}{$in_iface}{tx_bytes} = $1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"network::${host}::interface::${in_iface}::tx_bytes" => $anvil->data->{network}{$host}{interface}{$in_iface}{tx_bytes}." (".$anvil->Convert->bytes_to_human_readable({'bytes' => $anvil->data->{network}{$host}{interface}{$in_iface}{tx_bytes}}).")",
}});
}
}
}
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
next if not $in_iface;
if ($in_iface eq "lo")
{
# We don't care about 'lo'.
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
delete $anvil->data->{network}{$host}{interface}{$in_iface};
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
next;
}
if ($line =~ /inet (.*?)\/(.*?) /)
{
my $ip = $1;
my $cidr = $2;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { ip => $ip, cidr => $cidr }});
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $subnet_mask = $cidr;
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (($cidr =~ /^\d{1,2}$/) && ($cidr >= 0) && ($cidr <= 32))
{
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# Convert to subnet mask
$subnet_mask = $anvil->Convert->cidr({cidr => $cidr});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { subnet_mask => $subnet_mask }});
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$in_iface}{ip} = $ip;
$anvil->data->{network}{$host}{interface}{$in_iface}{subnet_mask} = $subnet_mask;
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"s1:network::${host}::interface::${in_iface}::ip" => $anvil->data->{network}{$host}{interface}{$in_iface}{ip},
"s2:network::${host}::interface::${in_iface}::subnet_mask" => $anvil->data->{network}{$host}{interface}{$in_iface}{subnet_mask},
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
}
* Updated Network->get_ips() to (again) record the MAC addresses and to create a MAC to interface name lookup hash. This was (accidentally?) removed back when the ->get_ips() was changed to store the data in a host-specific hash. * Updated tools/anvil-configure-host to use the new MAC to interface name lookup hash. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
if ($line =~ /ether (.*?) /i)
{
* Updated Network->get_ips() to check for 'permaddr' when processing 'ip addr list' to ensure the partmanent MAC is used. * Updated scan-filesystems to set swap usage alerts to notice level only. * Updated scan-network to pull the permanent MAC address from an 'ethtool -P <iface>' call to deal with the fact that wireless interfaces don't have their real MAC in the sysfs address file. * Updated anvil-provision-server to set the rtc_tickpolicy to catchup. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my $mac_address = $1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { mac_address => $mac_address }});
# Wireless interfaces have a 'permaddr' that is stable. The MAC address shown by 'ether' changes constantly, for some odd reason.
if ($line =~ /permaddr (.*)$/)
{
$mac_address = $1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { mac_address => $mac_address }});
}
$anvil->data->{network}{$host}{interface}{$in_iface}{mac_address} = $mac_address;
* Updated Network->get_ips() to (again) record the MAC addresses and to create a MAC to interface name lookup hash. This was (accidentally?) removed back when the ->get_ips() was changed to store the data in a host-specific hash. * Updated tools/anvil-configure-host to use the new MAC to interface name lookup hash. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Updated the pacemaker server config to drop the stop timeout to 5 minutes and the migration timeout to 10 minutes. This will avoid blocking the entire cluster when a stop or migrate operation times out. Will update scan-server to clean these up when they happen. * Updated Database->archive_table() and ->_find_behind_databases() to loop through connected databases, instead of configured databases. * Updated Network->get_ips() to only record the real MAC addresses on network interfaces (not bonds or bridges) in the "network::${host}::interface::${in_iface}::mac_address" hash. This should help avoid reboot loops caused by anvil-configure-host thinking the network needs to be reconfigured when it doesn't actually need to be. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
"network::${host}::interface::${in_iface}::mac_address" => $anvil->data->{network}{$host}{interface}{$in_iface}{mac_address},
* Updated Network->get_ips() to (again) record the MAC addresses and to create a MAC to interface name lookup hash. This was (accidentally?) removed back when the ->get_ips() was changed to store the data in a host-specific hash. * Updated tools/anvil-configure-host to use the new MAC to interface name lookup hash. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
}});
* Updated the pacemaker server config to drop the stop timeout to 5 minutes and the migration timeout to 10 minutes. This will avoid blocking the entire cluster when a stop or migrate operation times out. Will update scan-server to clean these up when they happen. * Updated Database->archive_table() and ->_find_behind_databases() to loop through connected databases, instead of configured databases. * Updated Network->get_ips() to only record the real MAC addresses on network interfaces (not bonds or bridges) in the "network::${host}::interface::${in_iface}::mac_address" hash. This should help avoid reboot loops caused by anvil-configure-host thinking the network needs to be reconfigured when it doesn't actually need to be. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# If this is a bond or bridge, don't record the MAC address. It confuses things as
# they show the MAC of the active interface. If this is an interface, see if the file
# '/sys/class/net/<nic>/bonding_slave/perm_hwaddr' exists and, if so, read the MAC
# address from there. If not, read the MAC address from
# '/sys/class/net/<nic>/address'.
my $shell_call = 'IFACE='.$in_iface.'
* Fixed a bug in Network->get_ips() bridge detection bashlet. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
if [ -e "/sys/class/net/${IFACE}/bridge" ];
* Updated the pacemaker server config to drop the stop timeout to 5 minutes and the migration timeout to 10 minutes. This will avoid blocking the entire cluster when a stop or migrate operation times out. Will update scan-server to clean these up when they happen. * Updated Database->archive_table() and ->_find_behind_databases() to loop through connected databases, instead of configured databases. * Updated Network->get_ips() to only record the real MAC addresses on network interfaces (not bonds or bridges) in the "network::${host}::interface::${in_iface}::mac_address" hash. This should help avoid reboot loops caused by anvil-configure-host thinking the network needs to be reconfigured when it doesn't actually need to be. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
then
echo bridge;
* Fixed a bug in Network->get_ips() bridge detection bashlet. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
elif [ -e "/proc/net/bonding/${IFACE}" ];
* Updated the pacemaker server config to drop the stop timeout to 5 minutes and the migration timeout to 10 minutes. This will avoid blocking the entire cluster when a stop or migrate operation times out. Will update scan-server to clean these up when they happen. * Updated Database->archive_table() and ->_find_behind_databases() to loop through connected databases, instead of configured databases. * Updated Network->get_ips() to only record the real MAC addresses on network interfaces (not bonds or bridges) in the "network::${host}::interface::${in_iface}::mac_address" hash. This should help avoid reboot loops caused by anvil-configure-host thinking the network needs to be reconfigured when it doesn't actually need to be. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
then
echo bond;
else
Updated anvil-update-states to use the permanent MAC addresses, as done in scan-network. Updated Network->get_ips() to do the same. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
ethtool -P ${IFACE}
* Updated the pacemaker server config to drop the stop timeout to 5 minutes and the migration timeout to 10 minutes. This will avoid blocking the entire cluster when a stop or migrate operation times out. Will update scan-server to clean these up when they happen. * Updated Database->archive_table() and ->_find_behind_databases() to loop through connected databases, instead of configured databases. * Updated Network->get_ips() to only record the real MAC addresses on network interfaces (not bonds or bridges) in the "network::${host}::interface::${in_iface}::mac_address" hash. This should help avoid reboot loops caused by anvil-configure-host thinking the network needs to be reconfigured when it doesn't actually need to be. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
fi';
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { shell_call => $shell_call }});
if ($is_local)
{
# Local call.
($output, my $return_code) = $anvil->System->call({debug => $debug, shell_call => $shell_call});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:return_code' => $return_code,
}});
}
else
{
# Remote call
($output, my $error, my $return_code) = $anvil->Remote->call({
debug => $debug,
shell_call => $shell_call,
target => $target,
user => $remote_user,
password => $password,
remote_user => $remote_user,
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:error' => $error,
's3:return_code' => $return_code,
}});
}
foreach my $line (split/\n/, $output)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
Updated anvil-update-states to use the permanent MAC addresses, as done in scan-network. Updated Network->get_ips() to do the same. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
if ($line =~ /^.*: (\w\w:\w\w:\w\w:\w\w:\w\w:\w\w)$/)
* Updated the pacemaker server config to drop the stop timeout to 5 minutes and the migration timeout to 10 minutes. This will avoid blocking the entire cluster when a stop or migrate operation times out. Will update scan-server to clean these up when they happen. * Updated Database->archive_table() and ->_find_behind_databases() to loop through connected databases, instead of configured databases. * Updated Network->get_ips() to only record the real MAC addresses on network interfaces (not bonds or bridges) in the "network::${host}::interface::${in_iface}::mac_address" hash. This should help avoid reboot loops caused by anvil-configure-host thinking the network needs to be reconfigured when it doesn't actually need to be. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
{
my $real_mac = $1;
$anvil->data->{network}{$host}{interface}{$in_iface}{mac_address} = $real_mac;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"network::${host}::interface::${in_iface}::mac_address" => $anvil->data->{network}{$host}{interface}{$in_iface}{mac_address},
}});
# Make it easy to look up an interface name based on a given MAC
# address.
$anvil->data->{network}{$host}{mac_address}{$real_mac}{interface} = $in_iface;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"network::${host}::mac_address::${real_mac}::interface" => $anvil->data->{network}{$host}{mac_address}{$real_mac}{interface},
}});
}
}
* Updated Network->get_ips() to (again) record the MAC addresses and to create a MAC to interface name lookup hash. This was (accidentally?) removed back when the ->get_ips() was changed to store the data in a host-specific hash. * Updated tools/anvil-configure-host to use the new MAC to interface name lookup hash. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
}
* Updated Jobs->get_job_details() to use --job-uuid switch or, failing that, look for an incomplete on this host with the same command as the calling program. * Got anvil-join-anvil to the point that it reworks the network configs, updates MTUs and configured NTP. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
if ($line =~ /mtu (\d+) /i)
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
* Updated Jobs->get_job_details() to use --job-uuid switch or, failing that, look for an incomplete on this host with the same command as the calling program. * Got anvil-join-anvil to the point that it reworks the network configs, updates MTUs and configured NTP. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
my $mtu = $1;
$anvil->data->{network}{$host}{interface}{$in_iface}{mtu} = $mtu;
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Updated Jobs->get_job_details() to use --job-uuid switch or, failing that, look for an incomplete on this host with the same command as the calling program. * Got anvil-join-anvil to the point that it reworks the network configs, updates MTUs and configured NTP. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
"network::${host}::interface::${in_iface}::mtu" => $anvil->data->{network}{$host}{interface}{$in_iface}{mtu},
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
}
}
# Read the config files for the interfaces we've found. Use 'ls' to find the interface files. Then
# we'll read them all in.
$shell_call = $anvil->data->{path}{exe}{ls}." ".$anvil->data->{path}{directories}{ifcfg};
$output = "";
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if ($is_local)
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Local call.
($output, my $return_code) = $anvil->System->call({debug => $debug, shell_call => $shell_call});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:return_code' => $return_code,
}});
}
else
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Remote call
($output, my $error, my $return_code) = $anvil->Remote->call({
debug => $debug,
shell_call => $shell_call,
target => $target,
user => $remote_user,
password => $password,
remote_user => $remote_user,
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:error' => $error,
's3:return_code' => $return_code,
}});
}
foreach my $line (split/\n/, $output)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
next if $line !~ /^ifcfg-/;
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $full_path = $anvil->data->{path}{directories}{ifcfg}."/".$line;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { full_path => $full_path }});
my $file_body = $anvil->Storage->read_file({
debug => $debug,
file => $full_path,
target => $target,
password => $password,
port => $port,
remote_user => $remote_user,
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"s1:full_path" => $full_path,
"s2:file_body" => $file_body,
}});
# Break it apart and store any variables.
my $temp = {};
my $interface = "";
foreach my $line (split/\n/, $file_body)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
next if $line =~ /^#/;
if ($line =~ /(.*?)=(.*)/)
{
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $variable = $1;
my $value = $2;
$value =~ s/^"(.*)"$/$1/;
$temp->{$variable} = $value;
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { "temp->{$variable}" => $temp->{$variable} }});
if (uc($variable) eq "DEVICE")
{
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# If this isn't a device we saw in 'ip addr', skip it by just not setting the interface variable
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { value => $value }});
last if not exists $anvil->data->{network}{$host}{interface}{$value};
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$interface = $value;
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { interface => $interface }});
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
}
if ($interface)
{
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface}{file} = $full_path;
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface}::file" => $anvil->data->{network}{$host}{interface}{$interface}{file},
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
foreach my $variable (sort {$a cmp $b} keys %{$temp})
{
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$interface}{variable}{$variable} = $temp->{$variable};
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${interface}::file::variable::${variable}" => $anvil->data->{network}{$host}{interface}{$interface}{variable}{$variable},
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
}
}
}
}
# Get the routing info.
my $lowest_metric = 99999999;
my $route_interface = "";
my $route_ip = "";
$shell_call = $anvil->data->{path}{exe}{ip}." route show";
$output = "";
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if ($is_local)
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Local call.
($output, my $return_code) = $anvil->System->call({debug => $debug, shell_call => $shell_call});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:return_code' => $return_code,
}});
}
else
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Remote call
($output, my $error, my $return_code) = $anvil->Remote->call({
debug => $debug,
shell_call => $shell_call,
target => $target,
user => $remote_user,
password => $password,
remote_user => $remote_user,
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:error' => $error,
's3:return_code' => $return_code,
}});
}
foreach my $line (split/\n/, $output)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
if ($line =~ /default via (.*?) dev (.*?) proto .*? metric (\d+)/i)
{
my $this_ip = $1;
my $this_interface = $2;
my $metric = $3;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:this_ip' => $this_ip,
's2:this_interface' => $this_interface,
's3:metric' => $metric,
's4:lowest_metric' => $lowest_metric,
}});
if ($metric < $lowest_metric)
{
$lowest_metric = $metric;
$route_interface = $this_interface;
$route_ip = $this_ip;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
lowest_metric => $lowest_metric,
route_interface => $route_interface,
route_ip => $route_ip,
}});
}
}
}
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
route_interface => $route_interface,
route_ip => $route_ip,
}});
# If I got a route, get the DNS.
if ($route_interface)
{
# I want to build the DNS list from only the interface that is used for routing.
my $in_interface = "";
my $dns_list = "";
my $dns_hash = {};
my $shell_call = $anvil->data->{path}{exe}{nmcli}." dev show";
my $output = "";
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if ($is_local)
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Local call.
($output, my $return_code) = $anvil->System->call({debug => $debug, shell_call => $shell_call});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:return_code' => $return_code,
}});
}
else
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# Remote call
($output, my $error, my $return_code) = $anvil->Remote->call({
debug => $debug,
shell_call => $shell_call,
target => $target,
user => $remote_user,
password => $password,
remote_user => $remote_user,
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:error' => $error,
's3:return_code' => $return_code,
}});
}
foreach my $line (split/\n/, $output)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
if ($line =~ /GENERAL.DEVICE:\s+(.*)$/)
{
$in_interface = $1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { in_interface => $in_interface }});
}
if (not $line)
{
$in_interface = "";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { in_interface => $in_interface }});
}
next if $in_interface ne $route_interface;
if ($line =~ /IP4.DNS\[(\d+)\]:\s+(.*)/i)
{
my $order = $1;
my $ip = $2;
$dns_hash->{$order} = $ip;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { "dns_hash->{$order}" => $dns_hash->{$order} }});
}
}
foreach my $order (sort {$a cmp $b} keys %{$dns_hash})
{
$dns_list .= $dns_hash->{$order}.", ";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
"s1:dns_hash->{$order}" => $dns_hash->{$order},
"s2:dns_list" => $dns_list,
}});
}
$dns_list =~ s/, $//;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { dns_list => $dns_list }});
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{network}{$host}{interface}{$route_interface}{default_gateway} = 1;
$anvil->data->{network}{$host}{interface}{$route_interface}{gateway} = $route_ip;
$anvil->data->{network}{$host}{interface}{$route_interface}{dns} = $dns_list;
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"network::${host}::interface::${route_interface}::default_gateway" => $anvil->data->{network}{$host}{interface}{$route_interface}{default_gateway},
"network::${host}::interface::${route_interface}::gateway" => $anvil->data->{network}{$host}{interface}{$route_interface}{gateway},
"network::${host}::interface::${route_interface}::dns" => $anvil->data->{network}{$host}{interface}{$route_interface}{dns},
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
}
return(0);
}
=head2 get_network
This takes an IP address and subnet and returns the network it belongs too. For example;
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $network = $anvil->Network->get_network({ip => "10.2.4.1", subnet_mask => "255.255.0.0"});
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
This would set C<< $network >> to C<< 10.2.0.0 >>.
If the network can't be caluclated for any reason, and empty string will be returned.
Parameters;
=head3 ip (required)
This is the IPv4 IP address being calculated.
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head3 subnet_mask (required)
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
This is the subnet mask of the IP address being calculated.
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=cut
sub get_network
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
* Updated all methods to add (or fix) logging the method entry. * More work done on Email->send_email() to, well, actually send email (which it isn't doing yet, but it's close). * Updated Words->key() to include the bad key name when no entry for the requested key exists in the words.xml file. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->get_network()" }});
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $network = "";
my $ip = defined $parameter->{ip} ? $parameter->{ip} : "";
my $subnet_mask = defined $parameter->{subnet_mask} ? $parameter->{subnet_mask} : "";
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
ip => $ip,
subnet_mask => $subnet_mask,
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
if (not $ip)
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->get_network()", parameter => "ip" }});
return("");
}
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (not $subnet_mask)
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->get_network()", parameter => "subnet_mask" }});
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return("");
}
* Standardized 'subnet_mask' over 'subnet' naming throughout. * Created (and haven't finished yet) Striker->parse_all_status_json(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $block = Net::Netmask->new($ip."/".$subnet_mask);
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $base = $block->base();
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { base => $base }});
* Renamed all Validate->is_X to Validate->X. Also created Validate->ipv6() to validate IPv6 addresses using Data::Validate::IP (and added it as a requirement to the .spec base RPM). * Added the fix from the last commit for System->call to handle returned data without an ending newline to Remote->call. * Got more work done on System->update_hosts(). It's able to add new hosts, but misses the short and FQDN host names. Need to fix that and the verify existing / manual entries aren't molested. Signed-off-by: digimer <digimer@pulsar.alteeve.com>
4 years ago
if ($anvil->Validate->ipv4({ip => $base}))
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
$network = $base;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { network => $network }});
}
return($network);
}
* Fixed bugs around ScanCore->check_power() so that it now returns time on batteries and highest charge are returned properly. * Created Network->is_our_interface() which returns '1' if an interface is one managed by an Anvil!. Also updated scan-network to use this to determine when an interface alert should be a warning or notice level alert. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 is_local
This method takes a host name or IP address and looks to see if it matches the local system. If it does, it returns C<< 1 >>. Otherwise it returns C<< 0 >>.
Parameters;
=head3 host (required)
This is the host name (or IP address) to check against the local system.
=cut
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
### NOTE: Do not log in here, it will cause a recursive loop!
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
sub is_local
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $host = $parameter->{host} ? $parameter->{host} : "";
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return(1) if not $host;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
host => $host,
}});
# If we've checked this host before, return the cached answer
if (exists $anvil->data->{cache}{is_local}{$host})
{
return($anvil->data->{cache}{is_local}{$host});
}
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{cache}{is_local}{$host} = 0;
* Moved the '_host_name', '_short_host_name', and '_domain_name' private methods in Tools.pm over to Get.pm (removing the leading '_' in the method names). * Created 'Cluster->which_node' that returns 'node1' or 'node2' to indicate which node a host is. * Continued working on scan_cluster; decided to make it not host-dependent. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
if (($host eq $anvil->Get->host_name) or
($host eq $anvil->Get->short_host_name) or
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
($host eq "localhost") or
($host eq "127.0.0.1"))
{
# It's local
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{cache}{is_local}{$host} = 1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { "cache::is_local::${host}" => $anvil->data->{cache}{is_local}{$host} }});
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
else
{
# Get the list of current IPs and see if they match.
* Moved the '_host_name', '_short_host_name', and '_domain_name' private methods in Tools.pm over to Get.pm (removing the leading '_' in the method names). * Created 'Cluster->which_node' that returns 'node1' or 'node2' to indicate which node a host is. * Continued working on scan_cluster; decided to make it not host-dependent. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
my $local_host = $anvil->Get->short_host_name();
* Switched all hash 'local' keys to be the host's short user name. Untested, likely bugs to be fixed in the next commit. Signed-off-by: Madison Kelly <mkelly@alteeve.ca>
4 years ago
if (not exists $anvil->data->{network}{$local_host}{interface})
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
$anvil->Network->get_ips({debug => 9999});
}
* Switched all hash 'local' keys to be the host's short user name. Untested, likely bugs to be fixed in the next commit. Signed-off-by: Madison Kelly <mkelly@alteeve.ca>
4 years ago
foreach my $interface (sort {$a cmp $b} keys %{$anvil->data->{network}{$local_host}{interface}})
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
* Forced anvil-daemon to log-level 2 and to enable secure logging to continue debugging setup issues. * Fixed a undefined variable warning. * Removed a debugging die from Database->resync_databases(). Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
next if not defined $anvil->data->{network}{$local_host}{interface}{$interface}{ip};
* Switched all hash 'local' keys to be the host's short user name. Untested, likely bugs to be fixed in the next commit. Signed-off-by: Madison Kelly <mkelly@alteeve.ca>
4 years ago
if ($host eq $anvil->data->{network}{$local_host}{interface}{$interface}{ip})
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->data->{cache}{is_local}{$host} = 1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { "cache::is_local::${host}" => $anvil->data->{cache}{is_local}{$host} }});
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
last;
}
}
}
* Fixed a tricky deep recursion bug in Network->is_local when the passed in host was an empty string. Also created a cache system where a host name that has been checked before is immediately returned, without needing to run through the logic in 'is_local', which gets called quite frequently. * Updated the loop detection logic in Log->entry where processing large strings was triggering it when it shouldn't. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
#$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { is_local => $is_local }});
return($anvil->data->{cache}{is_local}{$host});
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
* Fixed bugs around ScanCore->check_power() so that it now returns time on batteries and highest charge are returned properly. * Created Network->is_our_interface() which returns '1' if an interface is one managed by an Anvil!. Also updated scan-network to use this to determine when an interface alert should be a warning or notice level alert. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
=head2 is_our_interface
This method takes an interface name and returns C<< 1 >> if the interface is one of the ones we manage (A C<< BCN >>, C<< IFN >>, C<< SN >> or C<< MN >> interface). If not, C<< 0 >> is returned.
Parameters;
=head3 interface (required)
This is the name of the interface being evaluated.
=cut
sub is_our_interface
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->is_our_interface()" }});
my $interface = $parameter->{interface} ? $parameter->{interface} : "";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
interface => $interface,
}});
if (not $interface)
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->is_our_interface()", parameter => "interface" }});
return(0);
}
my $ours = 0;
if (($interface =~ /^bcn/i) or
($interface =~ /^sn/i) or
($interface =~ /^ifn/i) or
($interface =~ /^mn/i))
{
$ours = 1;
}
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { ours => $ours }});
return($ours);
}
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 is_ip_in_network
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
This takes an IP address, along with network and subnet mask and sees if the IP address is within the network. If it is, it returns C<< 1 >>. If the IP address doesn't match the network, C<< 0 >> is returned.
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
Parameters
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head3 ip (required)
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
This is the ip IP address being analyzed.
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head3 network (required)
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
This is the IP address that will be paired with the subnet mask to see if the ip matches.
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head3 subnet_mask (required)
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
This is the subnet mask paired against the IP address used to check the ip against.
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=cut
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
sub is_ip_in_network
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
* Updated all methods to add (or fix) logging the method entry. * More work done on Email->send_email() to, well, actually send email (which it isn't doing yet, but it's close). * Updated Words->key() to include the bad key name when no entry for the requested key exists in the words.xml file. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->is_ip_in_network()" }});
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $ip = defined $parameter->{ip} ? $parameter->{ip} : "";
my $network = defined $parameter->{network} ? $parameter->{network} : "";
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $subnet_mask = defined $parameter->{subnet_mask} ? $parameter->{subnet_mask} : "";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
ip => $ip,
network => $network,
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
subnet_mask => $subnet_mask,
}});
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (not $network)
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->is_ip_in_network()", parameter => "network" }});
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return(0);
}
* Renamed all Validate->is_X to Validate->X. Also created Validate->ipv6() to validate IPv6 addresses using Data::Validate::IP (and added it as a requirement to the .spec base RPM). * Added the fix from the last commit for System->call to handle returned data without an ending newline to Remote->call. * Got more work done on System->update_hosts(). It's able to add new hosts, but misses the short and FQDN host names. Need to fix that and the verify existing / manual entries aren't molested. Signed-off-by: digimer <digimer@pulsar.alteeve.com>
4 years ago
elsif (not $anvil->Validate->ipv4({ip => $network}))
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "warning_0019", variables => { parameter => "network", network => $network }});
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return(0);
}
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
if (not $ip)
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->is_ip_in_network()", parameter => "ip" }});
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return(0);
}
* Renamed all Validate->is_X to Validate->X. Also created Validate->ipv6() to validate IPv6 addresses using Data::Validate::IP (and added it as a requirement to the .spec base RPM). * Added the fix from the last commit for System->call to handle returned data without an ending newline to Remote->call. * Got more work done on System->update_hosts(). It's able to add new hosts, but misses the short and FQDN host names. Need to fix that and the verify existing / manual entries aren't molested. Signed-off-by: digimer <digimer@pulsar.alteeve.com>
4 years ago
elsif (not $anvil->Validate->ipv4({ip => $ip}))
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "warning_0019", variables => { parameter => "ip", network => $ip }});
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return(0);
}
if (not $subnet_mask)
{
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "log_0020", variables => { method => "Network->is_ip_in_network()", parameter => "subnet_mask" }});
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
return(0);
}
* Renamed all Validate->is_X to Validate->X. Also created Validate->ipv6() to validate IPv6 addresses using Data::Validate::IP (and added it as a requirement to the .spec base RPM). * Added the fix from the last commit for System->call to handle returned data without an ending newline to Remote->call. * Got more work done on System->update_hosts(). It's able to add new hosts, but misses the short and FQDN host names. Need to fix that and the verify existing / manual entries aren't molested. Signed-off-by: digimer <digimer@pulsar.alteeve.com>
4 years ago
elsif (not $anvil->Validate->subnet_mask({subnet_mask => $subnet_mask}))
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => 0, priority => "err", key => "warning_0020", variables => { parameter => "subnet_mask", subnet_mask => $subnet_mask }});
return(0);
}
my $match = 0;
* Renamed Network->match_gateway() to ->is_ip_in_network(), and changed the parameters 'gateway -> ip' and 'ip_address -> network'. This is to clarify it's use as a general purpose "does this IP fall in the given network range?". * Created the shell of Striker->generate_manifest() that will pull out CGI data to generate the install manifest itself and save/update it. * Got step 3 menu finished along with the corresponding sanity checks. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $block = Net::Netmask->new($network."/".$subnet_mask);
if ($block->match($ip))
* Created Network->match_gateway() to check if a gateway applies to a given network. * Got more work done on confirming the user's request to setup the network of a node or DR host. * Reworked network select boxes to sort by the network name instead of the MAC address. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
# This is a match!
$match = 1;
}
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { match => $match }});
return($match);
}
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 ping
This method will attempt to ping a target, by host name or IP, and returns C<< 1 >> if successful, and C<< 0 >> if not.
Example;
# Test access to the internet. Allow for three attempts to account for network jitter.
* Created Convert->fence_ipmilan_to_ipmitool() that takes a 'fence_ipmilan' call and converts it into a direct 'ipmitool' call. * Created Database->get_power() that loads data from the special 'power' table. * Fixed a bug in calls to Network->ping() where some weren't formatted properly for receiving two string variables. * Updated Database->get_anvils() to record the machine types when recording host information. * Updated Database->get_hosts_info() to also load the 'host_ipmi' column. * Updated Database->get_upses() to store the link to the 'power' -> 'power_uuid', when available. * Created ScanCore->call_scan_agents() that does the work of actually calling scan agents, moving the logic out from the scancore daemon. * Created ScanCore->check_power() that takes a host and the anvil it is in and returns if it's on batteries or not. If it is, the time on batteries and estimate hold-up time is returned. If not, the highest charge percentage is returned. * Created ScanCore->post_scan_analysis() that is a wrapper for calling the new ->post_scan_analysis_dr(), ->post_scan_analysis_node() and ->post_scan_analysis_striker(). Of which, _dr and _node are still empty, but _striker is complete. ** ->post_scan_analysis_striker() is complete. It now boots a node after a power loss if the UPSes powering it are OK (at least one has mains power, and the main-powered UPS(es) have reached the minimum charge percentage). If it's thermal, IPMI is called and so long as at least one thermal sensor is found and it/they are all OK, it is booted. For now, M2's thermal reboot delay logic hasn't been replicated, as it added a lot of complexity and didn't prove practically useful. * Created System->collect_ipmi_data() and moved 'scan_ipmitool's ipmitool call and parse into that method. This was done to allow ScanCore->post_scan_analysis_striker() to also call IPMI on a remote machine during thermal down events without reimplementing the logic. * Updated scan-ipmitool to only record temperature data for data collected locally. Also renamed 'machine' variables and hash keys to 'host_name' to clarify what is being stored. * Updated scancore to clear the 'system::stop_reason' variable. * Added missing packages to striker-manage-install-target. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
my ($pinged, $average_time) = $anvil->Network->ping({
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
ping => "google.ca",
count => 3,
});
# Test 9000-byte jumbo-frame access to a target over the BCN.
* Created Convert->fence_ipmilan_to_ipmitool() that takes a 'fence_ipmilan' call and converts it into a direct 'ipmitool' call. * Created Database->get_power() that loads data from the special 'power' table. * Fixed a bug in calls to Network->ping() where some weren't formatted properly for receiving two string variables. * Updated Database->get_anvils() to record the machine types when recording host information. * Updated Database->get_hosts_info() to also load the 'host_ipmi' column. * Updated Database->get_upses() to store the link to the 'power' -> 'power_uuid', when available. * Created ScanCore->call_scan_agents() that does the work of actually calling scan agents, moving the logic out from the scancore daemon. * Created ScanCore->check_power() that takes a host and the anvil it is in and returns if it's on batteries or not. If it is, the time on batteries and estimate hold-up time is returned. If not, the highest charge percentage is returned. * Created ScanCore->post_scan_analysis() that is a wrapper for calling the new ->post_scan_analysis_dr(), ->post_scan_analysis_node() and ->post_scan_analysis_striker(). Of which, _dr and _node are still empty, but _striker is complete. ** ->post_scan_analysis_striker() is complete. It now boots a node after a power loss if the UPSes powering it are OK (at least one has mains power, and the main-powered UPS(es) have reached the minimum charge percentage). If it's thermal, IPMI is called and so long as at least one thermal sensor is found and it/they are all OK, it is booted. For now, M2's thermal reboot delay logic hasn't been replicated, as it added a lot of complexity and didn't prove practically useful. * Created System->collect_ipmi_data() and moved 'scan_ipmitool's ipmitool call and parse into that method. This was done to allow ScanCore->post_scan_analysis_striker() to also call IPMI on a remote machine during thermal down events without reimplementing the logic. * Updated scan-ipmitool to only record temperature data for data collected locally. Also renamed 'machine' variables and hash keys to 'host_name' to clarify what is being stored. * Updated scancore to clear the 'system::stop_reason' variable. * Added missing packages to striker-manage-install-target. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
my ($jumbo_to_peer, $average_time) = $anvil->Network->ping({
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
ping => "an-a01n02.bcn",
count => 1,
payload => 9000,
fragment => 0,
});
# Check to see if an Anvil! node has internet access
* Created Convert->fence_ipmilan_to_ipmitool() that takes a 'fence_ipmilan' call and converts it into a direct 'ipmitool' call. * Created Database->get_power() that loads data from the special 'power' table. * Fixed a bug in calls to Network->ping() where some weren't formatted properly for receiving two string variables. * Updated Database->get_anvils() to record the machine types when recording host information. * Updated Database->get_hosts_info() to also load the 'host_ipmi' column. * Updated Database->get_upses() to store the link to the 'power' -> 'power_uuid', when available. * Created ScanCore->call_scan_agents() that does the work of actually calling scan agents, moving the logic out from the scancore daemon. * Created ScanCore->check_power() that takes a host and the anvil it is in and returns if it's on batteries or not. If it is, the time on batteries and estimate hold-up time is returned. If not, the highest charge percentage is returned. * Created ScanCore->post_scan_analysis() that is a wrapper for calling the new ->post_scan_analysis_dr(), ->post_scan_analysis_node() and ->post_scan_analysis_striker(). Of which, _dr and _node are still empty, but _striker is complete. ** ->post_scan_analysis_striker() is complete. It now boots a node after a power loss if the UPSes powering it are OK (at least one has mains power, and the main-powered UPS(es) have reached the minimum charge percentage). If it's thermal, IPMI is called and so long as at least one thermal sensor is found and it/they are all OK, it is booted. For now, M2's thermal reboot delay logic hasn't been replicated, as it added a lot of complexity and didn't prove practically useful. * Created System->collect_ipmi_data() and moved 'scan_ipmitool's ipmitool call and parse into that method. This was done to allow ScanCore->post_scan_analysis_striker() to also call IPMI on a remote machine during thermal down events without reimplementing the logic. * Updated scan-ipmitool to only record temperature data for data collected locally. Also renamed 'machine' variables and hash keys to 'host_name' to clarify what is being stored. * Updated scancore to clear the 'system::stop_reason' variable. * Added missing packages to striker-manage-install-target. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
my ($pinged, $average_time) = $anvil->Network->ping({
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
target => "an-a01n01.alteeve.com",
port => 22,
password => "super secret",
remote_user => "admin",
ping => "google.ca",
count => 3,
});
Parameters;
=head3 count (optional, default '1')
This tells the method how many time to try to ping the target. The method will return as soon as any ping attemp succeeds (unlike pinging from the command line, which always pings the requested count times).
=head3 debug (optional, default '3')
This is an optional way to alter to level at which this method is logged. Useful when the caller is trying to debug a problem. Generally this can be ignored.
=head3 fragment (optional, default '1')
When set to C<< 0 >>, the ping will fail if the packet has to be fragmented. This is meant to be used along side C<< payload >> for testing MTU sizes.
=head3 password (optional)
This is the password used to access a remote machine. This is used when pinging from a remote machine to a given ping target.
=head3 payload (optional)
This can be used to force the ping packet size to a larger number of bytes. It is most often used along side C<< fragment => 0 >> as a way to test if jumbo frames are working as expected.
B<NOTE>: The payload will have 28 bytes removed to account for ICMP overhead. So if you want to test an MTU of '9000', specify '9000' here. You do not need to account for the ICMP overhead yourself.
=head3 port (optional, default '22')
This is the port used to access a remote machine. This is used when pinging from a remote machine to a given ping target.
B<NOTE>: See C<< Remote->call >> for additional information on specifying the SSH port as part of the target.
=head3 remote_user (optional, default root)
If C<< target >> is set, this is the user we will use to log into the remote machine to run the actual ping.
=head3 target (optional)
This is the host name or IP address of a remote machine that you want to run the ping on. This is used to test a remote machine's access to a given ping target.
=head3 timeout (optional, default '1')
This is how long we will wait for a ping to return, in seconds. Any real number is allowed (C<< 1 >> (one second), C<< 0.25 >> (1/4 second), etc). If set to C<< 0 >>, we will wait for the ping command to exit without limit.
=cut
sub ping
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->ping()" }});
# my $start_time = [gettimeofday];
# print "Start time: [".$start_time->[0].".".$start_time->[1]."]\n";
#
# my $ping_time = tv_interval ($start_time, [gettimeofday]);
# print "[".$ping_time."] - Pinged: [$host]\n";
# If we were passed a target, try pinging from it instead of locally
my $count = defined $parameter->{count} ? $parameter->{count} : 1; # How many times to try to ping it? Will exit as soon as one succeeds
my $fragment = defined $parameter->{fragment} ? $parameter->{fragment} : 1; # Allow fragmented packets? Set to '0' to check MTU.
my $password = defined $parameter->{password} ? $parameter->{password} : "";
my $payload = defined $parameter->{payload} ? $parameter->{payload} : 0; # The size of the ping payload. Use when checking MTU.
my $ping = defined $parameter->{ping} ? $parameter->{ping} : "";
my $port = defined $parameter->{port} ? $parameter->{port} : "";
my $remote_user = defined $parameter->{remote_user} ? $parameter->{remote_user} : "root";
my $target = defined $parameter->{target} ? $parameter->{target} : "";
my $timeout = defined $parameter->{timeout} ? $parameter->{timeout} : 1; # This sets the 'timeout' delay.
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
count => $count,
fragment => $fragment,
payload => $payload,
password => $anvil->Log->is_secure($password),
ping => $ping,
port => $port,
remote_user => $remote_user,
target => $target,
}});
# Was timeout specified as a simple integer?
if (($timeout !~ /^\d+$/) && ($timeout !~ /^\d+\.\d+$/))
{
# The timeout was invalid, switch it to 1
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { timeout => $timeout }});
$timeout = 1;
}
# If the payload was set, take 28 bytes off to account for ICMP overhead.
if ($payload)
{
$payload -= 28;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { payload => $payload }});
}
# Build the call. Note that we use 'timeout' because if there is no connection and the host name is
# used to ping and DNS is not available, it could take upwards of 30 seconds time timeout otherwise.
my $shell_call = "";
if ($timeout)
{
$shell_call = $anvil->data->{path}{exe}{timeout}." $timeout ";
}
* Created Convert->fence_ipmilan_to_ipmitool() that takes a 'fence_ipmilan' call and converts it into a direct 'ipmitool' call. * Created Database->get_power() that loads data from the special 'power' table. * Fixed a bug in calls to Network->ping() where some weren't formatted properly for receiving two string variables. * Updated Database->get_anvils() to record the machine types when recording host information. * Updated Database->get_hosts_info() to also load the 'host_ipmi' column. * Updated Database->get_upses() to store the link to the 'power' -> 'power_uuid', when available. * Created ScanCore->call_scan_agents() that does the work of actually calling scan agents, moving the logic out from the scancore daemon. * Created ScanCore->check_power() that takes a host and the anvil it is in and returns if it's on batteries or not. If it is, the time on batteries and estimate hold-up time is returned. If not, the highest charge percentage is returned. * Created ScanCore->post_scan_analysis() that is a wrapper for calling the new ->post_scan_analysis_dr(), ->post_scan_analysis_node() and ->post_scan_analysis_striker(). Of which, _dr and _node are still empty, but _striker is complete. ** ->post_scan_analysis_striker() is complete. It now boots a node after a power loss if the UPSes powering it are OK (at least one has mains power, and the main-powered UPS(es) have reached the minimum charge percentage). If it's thermal, IPMI is called and so long as at least one thermal sensor is found and it/they are all OK, it is booted. For now, M2's thermal reboot delay logic hasn't been replicated, as it added a lot of complexity and didn't prove practically useful. * Created System->collect_ipmi_data() and moved 'scan_ipmitool's ipmitool call and parse into that method. This was done to allow ScanCore->post_scan_analysis_striker() to also call IPMI on a remote machine during thermal down events without reimplementing the logic. * Updated scan-ipmitool to only record temperature data for data collected locally. Also renamed 'machine' variables and hash keys to 'host_name' to clarify what is being stored. * Updated scancore to clear the 'system::stop_reason' variable. * Added missing packages to striker-manage-install-target. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
$shell_call .= $anvil->data->{path}{exe}{'ping'}." -W 1 -n ".$ping." -c 1";
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { shell_call => $shell_call }});
if (not $fragment)
{
$shell_call .= " -M do";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { shell_call => $shell_call }});
}
if ($payload)
{
$shell_call .= " -s $payload";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { shell_call => $shell_call }});
}
$shell_call .= " || ".$anvil->data->{path}{exe}{echo}." timeout";
Added a periodic check to ensure all users can ping. This fixes a bug where a local striker dashboard whose DB was stopped wouldn't work. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { shell_call => $shell_call }});
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $pinged = 0;
my $average_ping_time = 0;
foreach my $try (1..$count)
{
last if $pinged;
Added a periodic check to ensure all users can ping. This fixes a bug where a local striker dashboard whose DB was stopped wouldn't work. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
count => $count,
try => $try,
}});
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $output = "";
my $error = "";
* Switched all hash 'local' keys to be the host's short user name. Untested, likely bugs to be fixed in the next commit. Signed-off-by: Madison Kelly <mkelly@alteeve.ca>
4 years ago
# If the 'target' is set, we'll call over SSH unless 'target' is our host name.
Added a periodic check to ensure all users can ping. This fixes a bug where a local striker dashboard whose DB was stopped wouldn't work. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my $is_local = $anvil->Network->is_local({host => $target});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
target => $target,
is_local => $is_local,
}});
if ($is_local)
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
### Local calls
Added a periodic check to ensure all users can ping. This fixes a bug where a local striker dashboard whose DB was stopped wouldn't work. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
($output, my $return_code) = $anvil->System->call({
debug => $debug,
shell_call => $shell_call,
});
* Removed Network->is_remote, standardized on Network->is_local, and flipped calls to it to be more sensible (is_local -> local call -> else remote call). Also fixed a deep recursion issue with ->is_local where, given that it logs (which calls Storage methods which have local/remote invocations), would loop. * Fixed a bug where '$target' being preset to 'local' was causing bad calls to 'Remote->call'. * Updated Storage->change_mode and -> change_owner to work locally and on remote hosts. * Barely started work on striker->process_anvil_menu(). Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { output => $output, return_code => $return_code }});
}
else
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
{
### Remote calls
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0166", variables => { shell_call => $shell_call, target => $target, remote_user => $remote_user }});
($output, $error, my $return_code) = $anvil->Remote->call({
debug => $debug,
shell_call => $shell_call,
target => $target,
port => $port,
password => $password,
remote_user => $remote_user,
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
error => $error,
output => $output,
return_code => $return_code,
}});
}
foreach my $line (split/\n/, $output)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
if ($line =~ /(\d+) packets transmitted, (\d+) received/)
{
# This isn't really needed, but might help folks watching the logs.
my $pings_sent = $1;
my $pings_received = $2;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
pings_sent => $pings_sent,
pings_received => $pings_received,
}});
if ($pings_received)
{
# Contact!
$pinged = 1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { pinged => $pinged }});
* Created Convert->fence_ipmilan_to_ipmitool() that takes a 'fence_ipmilan' call and converts it into a direct 'ipmitool' call. * Created Database->get_power() that loads data from the special 'power' table. * Fixed a bug in calls to Network->ping() where some weren't formatted properly for receiving two string variables. * Updated Database->get_anvils() to record the machine types when recording host information. * Updated Database->get_hosts_info() to also load the 'host_ipmi' column. * Updated Database->get_upses() to store the link to the 'power' -> 'power_uuid', when available. * Created ScanCore->call_scan_agents() that does the work of actually calling scan agents, moving the logic out from the scancore daemon. * Created ScanCore->check_power() that takes a host and the anvil it is in and returns if it's on batteries or not. If it is, the time on batteries and estimate hold-up time is returned. If not, the highest charge percentage is returned. * Created ScanCore->post_scan_analysis() that is a wrapper for calling the new ->post_scan_analysis_dr(), ->post_scan_analysis_node() and ->post_scan_analysis_striker(). Of which, _dr and _node are still empty, but _striker is complete. ** ->post_scan_analysis_striker() is complete. It now boots a node after a power loss if the UPSes powering it are OK (at least one has mains power, and the main-powered UPS(es) have reached the minimum charge percentage). If it's thermal, IPMI is called and so long as at least one thermal sensor is found and it/they are all OK, it is booted. For now, M2's thermal reboot delay logic hasn't been replicated, as it added a lot of complexity and didn't prove practically useful. * Created System->collect_ipmi_data() and moved 'scan_ipmitool's ipmitool call and parse into that method. This was done to allow ScanCore->post_scan_analysis_striker() to also call IPMI on a remote machine during thermal down events without reimplementing the logic. * Updated scan-ipmitool to only record temperature data for data collected locally. Also renamed 'machine' variables and hash keys to 'host_name' to clarify what is being stored. * Updated scancore to clear the 'system::stop_reason' variable. * Added missing packages to striker-manage-install-target. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
last;
* Created Network->check_internet() that, well, checks to see if a machine has access to the Internet or not. * Moved System->is_local to Network->is_local, and System->ping to Network->ping. * Added a check to tools/striker-get-peer-data that will report if the target has Internet access or not. * Cleaned up the form that prompts the user to enter their Red Hat credentials. * Updated tools/anvil-manage-keys (and related code) to no longer distinguish by user. If a target is flagged as changed, it is removed from the root and all user's known_hosts files. * Updated Storage->write_file() and ->update_file() to accept the 'backup' parameter to control if an file that exists is backed up before being updated/replaced. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
else
{
# Not yet... Sleep to give time for transient network problems to
# pass.
sleep 1;
}
}
if ($line =~ /min\/avg\/max\/mdev = .*?\/(.*?)\//)
{
$average_ping_time = $1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { average_ping_time => $average_ping_time }});
}
}
}
# 0 == Ping failed
# 1 == Ping success
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
pinged => $pinged,
average_ping_time => $average_ping_time,
}});
return($pinged, $average_ping_time);
}
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
=head2 read_nmcli
This method reads and parses the C<< nmcli >> data. The data is stored as;
nmcli::<host>::uuid::<uuid>::name
nmcli::<host>::uuid::<uuid>::type
nmcli::<host>::uuid::<uuid>::timestamp_unix
nmcli::<host>::uuid::<uuid>::timestamp
nmcli::<host>::uuid::<uuid>::autoconnect
nmcli::<host>::uuid::<uuid>::autoconnect_priority
nmcli::<host>::uuid::<uuid>::read_only
nmcli::<host>::uuid::<uuid>::dbus_path
nmcli::<host>::uuid::<uuid>::active
nmcli::<host>::uuid::<uuid>::device
nmcli::<host>::uuid::<uuid>::state
nmcli::<host>::uuid::<uuid>::active_path
nmcli::<host>::uuid::<uuid>::slave
nmcli::<host>::uuid::<uuid>::filename
Where C<< uuid >> is the UUID of the connection. For C<< host >>, please see the parameter below. For information on what each value means, please see C<< man nmcli >>.
For each of reference, the following to values are also stored;
nmcli::<host>::name_to_uuid::<name>
nmcli::<host>::device_to_uuid::<device>
Where C<< name >> is the value in the interface set by the C<< NAME= >> variable and C<< device >> is the interface name (as used in C<< ip >>) and as set in the C<< DEVICE= >> variable in the C<< ifcfg-X >> files.
Parameters;
* Switched all hash 'local' keys to be the host's short user name. Untested, likely bugs to be fixed in the next commit. Signed-off-by: Madison Kelly <mkelly@alteeve.ca>
4 years ago
=head3 host (optional, default 'target' or local short host name)
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
This is the hash key under which the parsed C<< nmcli >> data is stored. By default, this is C<< local >> when called locally, or it will be C<< target >> if C<< target >> is passed.
=head3 password (optional)
This is the password used to access a remote machine. This is used when reading C<< nmcli >> data on a remote system.
=head3 port (optional, default '22')
This is the port used to access a remote machine. This is used when reading C<< nmcli >> data on a remote system.
=head3 remote_user (optional, default root)
If C<< target >> is set, this is the remote user we use to log into the remote system.
=head3 target (optional)
This is the host name or IP address of a remote machine that you want to read C<< nmcli >> data from.
=cut
sub read_nmcli
{
my $self = shift;
my $parameter = shift;
my $anvil = $self->parent;
my $debug = defined $parameter->{debug} ? $parameter->{debug} : 3;
$anvil->Log->entry({source => $THIS_FILE, line => __LINE__, level => $debug, key => "log_0125", variables => { method => "Network->read_nmcli()" }});
# If we were passed a target, try pinging from it instead of locally
my $password = defined $parameter->{password} ? $parameter->{password} : "";
my $host = defined $parameter->{host} ? $parameter->{host} : "";
my $port = defined $parameter->{port} ? $parameter->{port} : "";
my $remote_user = defined $parameter->{remote_user} ? $parameter->{remote_user} : "root";
my $target = defined $parameter->{target} ? $parameter->{target} : "";
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
host => $host,
password => $anvil->Log->is_secure($password),
port => $port,
remote_user => $remote_user,
target => $target,
}});
if (not $host)
{
* Moved the '_host_name', '_short_host_name', and '_domain_name' private methods in Tools.pm over to Get.pm (removing the leading '_' in the method names). * Created 'Cluster->which_node' that returns 'node1' or 'node2' to indicate which node a host is. * Continued working on scan_cluster; decided to make it not host-dependent. Signed-off-by: Digimer <digimer@alteeve.ca>
4 years ago
$host = $target ? $target : $anvil->Get->short_host_name();
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { host => $host }});
}
if (exists $anvil->data->{nmcli}{$host})
{
delete $anvil->data->{nmcli}{$host};
}
# Reading locally or remote?
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my $shell_call = $anvil->data->{path}{exe}{nmcli}." --colors no --terse --fields name,device,state,type,uuid,filename connection show";
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
my $output = "";
my $is_local = $anvil->Network->is_local({host => $target});
if ($is_local)
{
# Local call.
($output, my $return_code) = $anvil->System->call({debug => $debug, shell_call => $shell_call});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:return_code' => $return_code,
}});
}
else
{
# Remote call
($output, my $error, my $return_code) = $anvil->Remote->call({
debug => $debug,
shell_call => $shell_call,
target => $target,
user => $remote_user,
password => $password,
remote_user => $remote_user,
});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
's1:output' => $output,
's2:error' => $error,
's3:return_code' => $return_code,
}});
}
foreach my $line (split/\n/, $output)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { 'line >>' => $line }});
$line =~ s/\\:/!col!/g;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { 'line <<' => $line }});
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my ($name, $device, $state, $type, $uuid, $filename) = (split/:/, $line);
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => {
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
's1:name' => $name,
's2:device' => $device,
's3:state' => $state,
's4:type' => $type,
's5:uuid' => $uuid,
's6:filename' => $filename,
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
if ($uuid)
{
# Inactive interfaces have a name but not a device;
if (not $device)
{
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
# Read the file, see if we can find it there.
if (-e $filename)
{
my $file_body = $anvil->Storage->read_file({debug => ($debug+1), file => $filename});
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { file_body => $file_body }});
foreach my $line (split/\n/, $file_body)
{
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { line => $line }});
$line =~ s/#.*$//;
if ($line =~ /DEVICE=(.*)$/)
{
$device = $1;
$device =~ s/^\s+//;
$device =~ s/\s+$//;
$device =~ s/"(.*)"$/$1/;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { device => $device }});
}
}
}
if (not $device)
{
# Odd. Well, pull the device off the file name.
$device = ($filename =~ /\/ifcfg-(.*)$/)[0];
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { device => $device }});
}
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}
# Make it easy to look up a device's UUID by device or name.
$anvil->data->{nmcli}{$host}{name_to_uuid}{$name} = $uuid;
$anvil->data->{nmcli}{$host}{device_to_uuid}{$device} = $uuid;
Note: Continuing to resolve the build issues with network startup. Expect breakage. * Upped the aging of jobs and alerts data from 2 to 24 hours. Also added a check to prevent deleting a job of any age that is incomplete. * Major update to anvil-configure-host to not touch the network unless something has actually changed. Not yet tested on a fresh system, will verify nothing broke in the CI tests this commit will trigger. Also changed it so that, if after reconfiguring the network it times out trying to reconnect to a database, it calls a reboot instead of simply exiting. Further, a reboot is now not called on exit unless something changed to require it. * Updated Network->check_bonds() to return '1' if anything was done to heal a bond. * Updated anvil-update-states to be more careful about clearing virsh bridges. Specifically, it checks to see if virsh is running and that the returned bridges aren't actually error codes. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => 2, list => {
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
"nmcli::${host}::name_to_uuid::${name}" => $anvil->data->{nmcli}{$host}{name_to_uuid}{$name},
"nmcli::${host}::device_to_uuid::${device}" => $anvil->data->{nmcli}{$host}{device_to_uuid}{$device},
}});
# Translate some values;
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
my $say_state = not $state ? 0 : 1;
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => $debug, list => { say_state => $say_state }});
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
# Now store the data
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->data->{nmcli}{$host}{uuid}{$uuid}{name} = $name;
$anvil->data->{nmcli}{$host}{uuid}{$uuid}{device} = $device;
$anvil->data->{nmcli}{$host}{uuid}{$uuid}{'state'} = $state;
$anvil->data->{nmcli}{$host}{uuid}{$uuid}{type} = $type;
$anvil->data->{nmcli}{$host}{uuid}{$uuid}{filename} = $filename;
Note: Continuing to resolve the build issues with network startup. Expect breakage. * Upped the aging of jobs and alerts data from 2 to 24 hours. Also added a check to prevent deleting a job of any age that is incomplete. * Major update to anvil-configure-host to not touch the network unless something has actually changed. Not yet tested on a fresh system, will verify nothing broke in the CI tests this commit will trigger. Also changed it so that, if after reconfiguring the network it times out trying to reconnect to a database, it calls a reboot instead of simply exiting. Further, a reboot is now not called on exit unless something changed to require it. * Updated Network->check_bonds() to return '1' if anything was done to heal a bond. * Updated anvil-update-states to be more careful about clearing virsh bridges. Specifically, it checks to see if virsh is running and that the returned bridges aren't actually error codes. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
$anvil->Log->variables({source => $THIS_FILE, line => __LINE__, level => 2, list => {
* I _might_ have fixed the network configuration issue in anvil-configure-host... Updated it so that if 'nmcli' doesn't report a valid device name, it looks for it in the ifcfg-X file, and uses 'X' if not found there. * Added the 'print' parameter to Log->variables() to allow printing to STDOUT when set. * Renamed Network->check_bonds() to Network->check_networks() in anticipation of adding bridge monitoring / repair to it later. Signed-off-by: Digimer <digimer@alteeve.ca>
3 years ago
"nmcli::${host}::uuid::${uuid}::name" => $anvil->data->{nmcli}{$host}{uuid}{$uuid}{name},
"nmcli::${host}::uuid::${uuid}::device" => $anvil->data->{nmcli}{$host}{uuid}{$uuid}{device},
"nmcli::${host}::uuid::${uuid}::state" => $anvil->data->{nmcli}{$host}{uuid}{$uuid}{'state'},
"nmcli::${host}::uuid::${uuid}::type" => $anvil->data->{nmcli}{$host}{uuid}{$uuid}{type},
"nmcli::${host}::uuid::${uuid}::filename" => $anvil->data->{nmcli}{$host}{uuid}{$uuid}{filename},
* Finished tools/anvil-configure-host! More notably, it can now update the network without a reboot, and it cleanly handles losing and reconnecting to dashboards. * Added 'no_ping' to Database->connect() to disable pinging before connection, regardless of the anvil.conf setting. * Created Network->read_nmcli() that reads, parses and stores the verbose output from 'nmcli'. I can not properly explain in this commit message how much getting network manager working tripped me up. omg the complexity of what used to be such a simple process... Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
}});
}
}
return(0);
}
* Finished the initial tools/striker-initialize-host! * Created Tools->refresh to reload anvil.conf in one call. * Created Anvil::Tools::Network to hold network-related tasks. ** Created Network->is_remote() that tests to see if a string (containing a target) refers to the remote machine (versus a local machine). Updated all previous checks to use this new method. ** Moved Get->network_details() and Get->network() to the new Network module. Renamed Get->network() to Network->get_network(). ** Made Network->get_ips() work locally and remotely. ** Created Network->find_matches() that compares two scanned machines IPs (via two previous calls to Network->get_ips()) * Created Database->manage_anvil_conf() that will add, update or remove a given database connection in a local or remote anvil.conf file. * Fixed bugs in Storage->backup() where the bash calls were quite broken. I'm not sure how it ever worked before... x_x * Updated anvil-daemon to not initialize a database unless it's running on dashboard. Also added a check at the startup of anvil-daemon where it will go into a loop waiting for a database to become available, re-reading anvil.conf each loop. Signed-off-by: Digimer <digimer@alteeve.ca>
5 years ago
#############################################################################################################
# Private functions #
#############################################################################################################
1;