Dell DX6004S DX Object Storage Administration Guide

Dell DX6004S Manual

Get Dell DX6004S PDF manuals and user guides View all Dell DX6004S manuals
Add to My Manuals
Save this manual to your list of manuals

Dell DX6004S manual content summary:

  • Dell DX6004S | DX Object Storage Administration Guide - Page 1
    DX Object Storage Administration Guide Version 5.0
  • Dell DX6004S | DX Object Storage Administration Guide - Page 2
    DX Object Storage Administration Guide: Version 5.0 Copyright © 2010 Caringo, Inc. All Rights Reserved. No part of this document may be reproduced, transmitted, or transcribed without the written consent of Caringo, Inc.
  • Dell DX6004S | DX Object Storage Administration Guide - Page 3
    Table of Contents 1. Welcome to DX Storage ...1 1.1. Overview of DX Storage 1 1.2. Components ...1 1.3. About this Document 1 1.3.1. Audience ...1 1.3.2. Scope ...1 2. Introduction to the Admin Console 2 2.1. Accessing the Admin Console 2 2.2. Initial View of the Admin Console 2 2.2.1. Viewing
  • Dell DX6004S | DX Object Storage Administration Guide - Page 4
    a License File 54 C.2. Software Upgrade Overview 54 C.2.1. Preparation 54 C.2.2. Upgrade Steps 55 C.3. Back-out Steps ...56 D. Troubleshooting ...57 D.1. Restoring Domains and Buckets 57 D.1.1. Recovering a Deleted Domain 57 D.1.2. Recovering a Deleted Bucket 60 D.2. Resolving Duplicate
  • Dell DX6004S | DX Object Storage Administration Guide - Page 5
    or DR Cluster 62 D.3. Using DX Content Router to List Buckets and Objects 64 D.4. Boot Errors ...64 D.5. Configuration ...65 D.6. Operational Problems 65 E. Drive Identification API ...67 E.1. Overview ...67 E.2. Customization Steps 67 F. Customizing the Admin Console 68 G. Open Source Software
  • Dell DX6004S | DX Object Storage Administration Guide - Page 6
    is made up of the following components. 1. Cluster of x86 computers/nodes with one or more physical volumes running DX Storage software 2. an addendum to, not a replacement of, the DX Storage Getting Started Guide, where basic configuration and installation is reviewed. The reader is expected to
  • Dell DX6004S | DX Object Storage Administration Guide - Page 7
    a CSN: http://CSN-external-IP:8090/servioes/storage If you are using a CSN, see the DX Object Storage Cluster Services Node (CSN) Installation and Configuration Guide for more information about managing your storage cluster. • Not using a CSN (that is, accessing a DX Storage node directly: http
  • Dell DX6004S | DX Object Storage Administration Guide - Page 8
    . If the cluster does not have a valid license, Unregistered displays instead of a company name. For more information about licensing, see the DX Storage Getting Started Guide. Copyright © 2010 Caringo, Inc. All rights reserved 3 Version 5.0 December 2010
  • Dell DX6004S | DX Object Storage Administration Guide - Page 9
    Note If the cluster does not have a valid license, an unregistered watermark, as shown in the following figure, displays behind the console. Copyright © 2010 Caringo, Inc. All rights reserved 4 Version 5.0 December 2010
  • Dell DX6004S | DX Object Storage Administration Guide - Page 10
    Chapter 3. Managing the Cluster To access the Admin Console, see Chapter 2, Introduction to the Admin Console. This chapter discusses the following topics: • Section 3.1, "Viewing the Cluster Status Page" • Section 3.2, "Authenticating Cluster-Wide Actions" • Section 3.3, "Shutting Down or
  • Dell DX6004S | DX Object Storage Administration Guide - Page 11
    admin and this user authenticates with Basic authentication (that is, the password is sent from your browser to the Admin Console in clear text). Dell strongly recommends you change admin's password immediately, that you use the names of real users, and that you encrypt users' passwords using Digest
  • Dell DX6004S | DX Object Storage Administration Guide - Page 12
    3.3. Shutting Down or Restarting the Cluster To shut down or restart all nodes in the cluster, click Shutdown Cluster or Restart Cluster in the top right of the Admin Console. Note It can take several minutes for the nodes to shut down or restart. 3.4. Viewing Nodes in the Cluster The cluster node
  • Dell DX6004S | DX Object Storage Administration Guide - Page 13
    The display of the cluster nodes and their status information is transmitted periodically. Therefore, there can be a delay of up to two minutes before node transitions are recorded on the admin console. This also means that the Admin Console view may differ slightly when two nodes are compared to
  • Dell DX6004S | DX Object Storage Administration Guide - Page 14
    . If you don't save the UUID, unpredictable behavior can result, including losing all your cluster-wide settings when you reboot the node. Note Dell recommends you do not set cluster-wide persisted parameters in individual node configuration files because these values must be the same for the whole
  • Dell DX6004S | DX Object Storage Administration Guide - Page 15
    particularly useful when troubleshooting an issue in and other services like DX remain suspended until it is manually reset by an administrator. Power DX Storage by default supports an adaptive power conservation feature Getting Started Guide for full a helpful computation of cluster available
  • Dell DX6004S | DX Object Storage Administration Guide - Page 16
    below. Space used is calculated against the lesser of the total physical space or the licensed space. For instance, in a cluster with 4TB of physical space but only 2TB of licensed space where 1.5TB of space is used, the console would report 75% Space Used. Logical Threshold* Ok (green) Warning (
  • Dell DX6004S | DX Object Storage Administration Guide - Page 17
    Chapter 4. Managing Tenants This chapter discusses how to manage cluster tenants. A tenant corresponds to a corporation or an organizational unit and consists of the following DX Storage components, which the Admin Console creates for you: • A domain, which is a container for buckets and objects. •
  • Dell DX6004S | DX Object Storage Administration Guide - Page 18
    to execute. The authorization list is specified by the Castor-Authorization header, which is discussed in detail in the DX Object Storage Application Guide. An authorization list can be associated with a domain, bucket, or named object. • User list (also referred to as a security realm or a realm
  • Dell DX6004S | DX Object Storage Administration Guide - Page 19
    (such as create, update, or delete). Note Every unnamed object belongs to the default cluster domain and, if you use security, POST permissions are supported for unnamed objects on the default cluster domain only. There is no reason to create a default cluster domain if your client applications use
  • Dell DX6004S | DX Object Storage Administration Guide - Page 20
    4.3. Security Privileges for Administrative Operations The following table shows the privileges required to perform administrative operations in a domain, bucket, or in the objects contained by them. Operation Create tenants Manage realms (that is, user lists) Privilege required CAStor
  • Dell DX6004S | DX Object Storage Administration Guide - Page 21
    cluster name that is not IANA-compliant, create an IANA-compliant domain name and create of all your named objects in buckets in that domain. • Dell strongly recommends you set up a default cluster domain (that is, a domain name that exactly matches the name of the cluster). Every object that has no
  • Dell DX6004S | DX Object Storage Administration Guide - Page 22
    • It cannot contain a comma (,), colon (:), space, or slash (/) character. • It must be a valid UTF-8 byte sequence. • It cannot be an IPv4 or IPv6 IP address. • It is case-insensitive. Note To use named objects in your cluster, you must create at least one domain. Unnamed objects do not require a
  • Dell DX6004S | DX Object Storage Administration Guide - Page 23
    ". Renaming an existing domain is supported only using the Admin Console. All Castor-Authorization header, see the DX Object Storage Application Guide. Domain managers have the ability to manage their own _administrators bucket. If you are trying to troubleshoot an issue with users being able to
  • Dell DX6004S | DX Object Storage Administration Guide - Page 24
    • User ID: Enter a name to identify the domain manager. Domain manager names can consist of ASCII characters only and cannot include a colon character (:). • Password: Enter the domain manager's password. • Re-Enter Password: Verify the password by entering it again. The following figure shows an
  • Dell DX6004S | DX Object Storage Administration Guide - Page 25
    see the chapter on introducing security in the DX Object Storage Application Guide. 4.7.1.1. Using Override to Delete an Object For example, to a new password. Although you can update a user list using PUT, Dell recommends you use APPEND because PUT replaces the user list, which might disable
  • Dell DX6004S | DX Object Storage Administration Guide - Page 26
    includes an MD5 hash using the HTTP Digest authentication algorithm. You compute user list or realm from the string username:realm:password. There wiki or bug report page for up-todate information about it. Dell testing and experience recommends you observe the following guidelines when using
  • Dell DX6004S | DX Object Storage Administration Guide - Page 27
    as a security realm or realm) is a collection of user credentials, each of which includes an MD5 hash using the HTTP Digest authentication algorithm. You compute user list or realm from the string username:realm:password. Important The realm name must exactly match the name of the domain or bucket
  • Dell DX6004S | DX Object Storage Administration Guide - Page 28
    the next step or you can remove the Castor-Authorization header and allow another user to modify it. To remove the Castor-Authorization header, use PUT or POST with the admin query argument and your credentials to upload a user realm to the object but do not specify a Castor-Authorization header in
  • Dell DX6004S | DX Object Storage Administration Guide - Page 29
    , see the Enumerator chapter in the SDK Overview. For information on creating DX Content Router rules, see the DX Content Router Setup and Configuration Guide. After you find the value of the object's Castor-System-CID header, access the object using the cid=CID-header-value query argument. To
  • Dell DX6004S | DX Object Storage Administration Guide - Page 30
    Chapter 5. Managing Nodes To access the Admin Console, see Chapter 2, Introduction to the Admin Console. 5.1. Viewing the Node Status Page To view the status of a node, click its IP address on the left side of the Admin Console. To search for a particular node, see Section 3.5, "Searching for Nodes
  • Dell DX6004S | DX Object Storage Administration Guide - Page 31
    available in the expandable Node Info, Node Configuration, Node Operations, and Hardware Status sections. The information in these sections can be helpful when working with support. Copyright © 2010 Caringo, Inc. All rights reserved 26 Version 5.0 December 2010
  • Dell DX6004S | DX Object Storage Administration Guide - Page 32
    Copyright © 2010 Caringo, Inc. All rights reserved 27 Version 5.0 December 2010
  • Dell DX6004S | DX Object Storage Administration Guide - Page 33
    and operational reporting if available for various hardware components installed on the node. Hardware status reporting is dependent on hardware that supports and populates IPMI sensors, SMART status, and in some cases manufacturer-specific components like SAS or iDRAC. Depending on your hardware
  • Dell DX6004S | DX Object Storage Administration Guide - Page 34
    5.2. Displaying Subcluster Information When subclusters are configured, the Node List is grouped first by subcluster name and then by IP address of the nodes. The first row of each subcluster includes a roll up of the status for the nodes in the subcluster. The following pictures depict 2
  • Dell DX6004S | DX Object Storage Administration Guide - Page 35
    ways: • If your cluster boots from a CSN, it is already set up to PXE boot. See the DX Object Storage Cluster Services Node (CSN) Installation and Configuration Guide for more information about configuring the DX Storage cluster. • If your cluster does not boot from a CSN, you can: • PXE boot
  • Dell DX6004S | DX Object Storage Administration Guide - Page 36
    The following table shows all configurations to control the operation of the DX Storage cluster nodes. If a parameter name displays as a link, click the link to jump to more information about that parameter. Option Name administrators Default {'admin':'ourpwdofchoicehere', 'snmp':'
  • Dell DX6004S | DX Object Storage Administration Guide - Page 37
    , both in viewing the cluster from the administration console and downstream in applications like DX Content Router that might analyze the source cluster, Dell highly recommends that all nodes in the cluster be configured with the same cluster name. UUID of the anchor stream that contains persistent
  • Dell DX6004S | DX Object Storage Administration Guide - Page 38
    Option Name domainHeaders Default none gateway group none 225.0.10.100 hpStartDelay 900 icmpAcceptRedirects true igmpVersion ioErrorTolerance ipaddress 2 200 none licenseFileURL file:///caringo/license.txt loghost loglevel none 40 logport 514 maxreps 16 Copyright © 2010 Caringo, Inc
  • Dell DX6004S | DX Object Storage Administration Guide - Page 39
    jumbo frames. Before you change the default MTU value, make sure the node's network interfaces and all other network hardware support the selected MTU. If the hardware does not support the new MTU value, nodes can be prevented from replicating objects and might not be able to communicate with each
  • Dell DX6004S | DX Object Storage Administration Guide - Page 40
    cluster nodes with HTTP requests. Number of seconds of inactivity before an active node or volume becomes idle in power saving mode. Minimum supported value is 60 seconds. This parameter was deprecated with the 3.0.2 release and is now removed. Starting after 3.0.2, this parameter was superseded by
  • Dell DX6004S | DX Object Storage Administration Guide - Page 41
    Option Name volPluginURL vols Default none none volumeRecovery- 0 Suspend wakeAfter 28800 (8 hours) Description to automatically assign storage volumes. Set to 0 to include all disk devices. Location of the volume identification tar file plugin if different from the default IO script.
  • Dell DX6004S | DX Object Storage Administration Guide - Page 42
    '} In the example, the CAStor administrators realm has two users, admin and snmp. Both users have the same password, ourpwdofchoicehere. For security reasons, Dell strongly recommends you change these users' passwords as soon as possible. Note The names admin and snmp are reserved and should not be
  • Dell DX6004S | DX Object Storage Administration Guide - Page 43
    must always be specified in the administrators parameter, although Dell recommends you change the user's password. Specifying console administrative use validation. During the read from the disk, the content hash is computed. If the hash is wrong, indicating logical disk corruption, the socket will
  • Dell DX6004S | DX Object Storage Administration Guide - Page 44
    volumes. Only one vols parameter is allowed in a configuration file. Warning DX Storage erases any non-DX Storage data on all the volumes it uses. Dell recommends you run DX Storage only on nodes that are free of non-DX Storage data. Copyright © 2010 Caringo, Inc. All rights reserved 39 Version
  • Dell DX6004S | DX Object Storage Administration Guide - Page 45
    server and multi-server configurations. • Supports exceptions, as discussed in Section 6.5.3, "Specifying Exceptions". • Supports :k (keep), which is discussed all is used, do not include any other device path specifications. Dell strongly recommends you use vols = all and discourages you from using
  • Dell DX6004S | DX Object Storage Administration Guide - Page 46
    policy The policy option enables you to instruct DX Storage how to handle a volume. for more information. 6.5.3. Specifying Exceptions Although Dell recommends you allow DX Storage to use of inactivity (2 hours by default). The smallest supported value is 60 seconds. 6.6.2. wakeAfter This option
  • Dell DX6004S | DX Object Storage Administration Guide - Page 47
    that the facility.level specification must be followed by a Tab character to separate it from the destination specification. See the syslog.conf manual page for more information. # /etc/syslog.conf local6.* /var/log/caringo/castor.log This example shows a sample configuration with the syslog-ng
  • Dell DX6004S | DX Object Storage Administration Guide - Page 48
    Example: timeSource = system Warning Extra care should be used when operating without an external NTP time source. Specifically, administrators will need to assure that all new nodes have their BIOS clocks set relatively close to the correct GMT time before they join the cluster. All DX Storage
  • Dell DX6004S | DX Object Storage Administration Guide - Page 49
    done. When a volume that is older than 14 days is forced to return to service, care must be taken because you might resurrect content that had been explicitly deleted by clients. This is not a problem for content that was deleted by automatic lifepoint policies because the content is discovered and
  • Dell DX6004S | DX Object Storage Administration Guide - Page 50
    guarantee that the extent of the error can be isolated or that the continued use of the failing device will allow the node to continue to operate normally with its other storage devices. For these reasons, DX Storage takes the conservative approach of retiring a device upon receipt of any physical
  • Dell DX6004S | DX Object Storage Administration Guide - Page 51
    The processes parameter enables you to specify the number of independent DX Storage server processes that should be started in a physical chassis. Dell recommends you use n-1 processes for a chassis with n CPU cores. Using too many DX Storage server processes impairs performance. The parameter value
  • Dell DX6004S | DX Object Storage Administration Guide - Page 52
    shared for all processes so they only need to be specified a single time, as in a single-process implementation. For example, for a chassis with two processes, the following node or cluster configuration file entries could be utilized: processes = 2 ipaddress = 192.10.11.200 192.10.11.201 netmask =
  • Dell DX6004S | DX Object Storage Administration Guide - Page 53
    loss. A loss could be events like a fire, flooding, or air conditioning problems. For more information about subclusters, see the chapter on hardware considerations in the DX Object Storage Getting Started Guide. A.2. Monitoring and Administration The Admin Console displays each physical chassis at
  • Dell DX6004S | DX Object Storage Administration Guide - Page 54
    which nodes and volumes within nodes can be taken down for service or retired from a DX Storage cluster. 1. castorShutdownAction 2. from the cluster. For a shutdown, the node will be powered off it the hardware supports this. For a reboot, the node will reboot to machine, re-read the node
  • Dell DX6004S | DX Object Storage Administration Guide - Page 55
    data has been copied elsewhere in the cluster, the node is permanently out of service and will not respond to further requests. In order to retire a node MIB definition file. Please refer the tool or package's specific instructions for doing this. B.3.1. Open Source Tools An administrator may find
  • Dell DX6004S | DX Object Storage Administration Guide - Page 56
    B.3.2. SNMP Examples with DX Storage The following example shows an SNMP walk of all the DX Storage values on a node. snmpwalk -v 2c -c pwd -m +CASTOR-MIB 192.168.1.101 caringo The following example shows the request of a specific SNMP variable from a DX Storage node. snmpget -v 2c -c pwd -m +CASTOR
  • Dell DX6004S | DX Object Storage Administration Guide - Page 57
    allows detailed indications of disk and capacity problems. B.3.4.1. Health Monitoring The following variables are from the disk hardware through the OS driver and to the DX Storage process. B.3.4.2. moved to other cluster nodes. In order to compute the amount of disk space that is available for
  • Dell DX6004S | DX Object Storage Administration Guide - Page 58
    volUsedMbytes / volMaxMbytes These disk usage variables can be totaled for all disk volumes in a node and all nodes in a cluster in order to produce capacity utilization reports. B.3.4.3. Client Activity Reporting It can be useful to collect and report the amount of client activity received by nodes
  • Dell DX6004S | DX Object Storage Administration Guide - Page 59
    customer information. All new license files must be either issued by your support representative or generated from the Licensing page of the CSN Console to a CSN, please reference the Cluster Services Node Installation and Configuration Guide for instructions on upgrading your DX Storage software on
  • Dell DX6004S | DX Object Storage Administration Guide - Page 60
    files. The sticks or configuration server can then be updated using the instructions in the README.txt file found in the ISO update cd for order to ensure that there are no hardware problems that could interrupt the upgrade process. Any problems should be corrected prior to upgrading. C.2.2. Upgrade
  • Dell DX6004S | DX Object Storage Administration Guide - Page 61
    a single node before starting the others in order to verify that the software runs and that it can communicate with the network. Verify that the first node boots properly then power up the other nodes in the cluster. When a node is first booted, there is a default window of 15 minutes, controlled by
  • Dell DX6004S | DX Object Storage Administration Guide - Page 62
    Appendix D. Troubleshooting This discusses the following suggested solutions to problems with DX Storage: • Section D.1, "Restoring Domains and on creating DX Content Router rules, see the DX Content Router Setup and Configuration Guide. • You must upload a realm (that is, user list) for the domain
  • Dell DX6004S | DX Object Storage Administration Guide - Page 63
    Protection setting All Users. No authentication required Only users in this domain Only users in domain Castor-Authorization header Castor-Authorization: domain-name/ _administrators, POST= Castor-Authorization: domain-name/ _administrators, POST=domain-name Castor-Authorization: domain-name/
  • Dell DX6004S | DX Object Storage Administration Guide - Page 64
    domain=cluster.example.com&admin&recreatecid=c0d0fa42bccac73cd3f2324bb53e40a5" --digest -u "admin:ourpwdofchoicehere" 5. Create the _administrators bucket for the domain. curl -i -X POST -H "Cache-Control: no-cache-context" -H "CastorAuthorization: domain-name/_administrators" -H "Castor-Stream-Type
  • Dell DX6004S | DX Object Storage Administration Guide - Page 65
    If you added a domain manager successfully, the procedure completed successfully. There is likely an alert in the Admin Console due to not having an _administrators bucket for the domain. You can optionally clear the error from the Admin Console as discussed in the next step. 12.Optional. Return to
  • Dell DX6004S | DX Object Storage Administration Guide - Page 66
    Router detects a duplicate domain, it logs a Critical error to its DX Storage Admin Console. If you are alerted to such an error, Dell suggests the following resolutions: • Recommended for a DR cluster conflict. Rename either domain in its source cluster. This method is recommended because it
  • Dell DX6004S | DX Object Storage Administration Guide - Page 67
    To resolve a conflict in a mirrored configuration, skip this section and use Section D.2.2, "Renaming a Domain in a Mirrored or DR Cluster" instead. To rename a domain in the source cluster of a DR cluster, use the Admin Console as follows: 1. Start the Admin Console as discussed in Chapter 2,
  • Dell DX6004S | DX Object Storage Administration Guide - Page 68
    H "Castor-Stream-Type: admin" --anyauth -u "cluster-administratorusername:password" --location-trusted "http://node-ip?domain=domainname&admin&aliasuuid=uuid&newname=new-domain-name" For example, to rename cluster.example.com to archive.example.com by sending commands to a node whose IP address is
  • Dell DX6004S | DX Object Storage Administration Guide - Page 69
    to start. 4. The node begins to boot but reports a "kernel panic" error and stops. This is likely a hardware compatibility issue with the hardware. Please contact support with the details of your hardware setup. Copyright © 2010 Caringo, Inc. All rights reserved 64 Version 5.0 December 2010
  • Dell DX6004S | DX Object Storage Administration Guide - Page 70
    the hardware. Please contact Caringo support with the details of your a USB stick is removed from a computer without unmounting, some changes can be hangs during boot while initializing ACPI services. Some hardware presents issues with the properly set. D.6. Operational Problems Symptom 1. A volume
  • Dell DX6004S | DX Object Storage Administration Guide - Page 71
    correct NIC. Depending upon the bus order and the order in which kernel drivers are loaded, the network ports may not match their external labeling. If the and the hardware is functioning properly, this may indicate a software problem. The DX Storage system has a built-in failsafe and will reboot
  • Dell DX6004S | DX Object Storage Administration Guide - Page 72
    Appendix E. Drive Identification API As of the 4.0 release, DX Storage supports a drive identification function that allows an administrator to select a volume from the admin console and have the LED associated with the volume flash for a selectable
  • Dell DX6004S | DX Object Storage Administration Guide - Page 73
    Appendix F. Customizing the Admin Console The console ships with a set of default styles. These styles are persisted in the following files. • console.css - baseline set of styles. • console_print.css - a small set of overrides for the printed page. • console_print_preview.css - the styles for the
  • Dell DX6004S | DX Object Storage Administration Guide - Page 74
    Appendix G. Open Source Software Regarding certain third party open source components also shipped with the product, please see the detailed information that appears in the document DX Storage OSS License Notices for 3rd Party Software.pdf. Your vendor will ship open/free/libre (for example, GPL-
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
DX Object Storage Administration Guide
Version 5.0