温馨提示×

温馨提示×

您好,登录后才能下订单哦!

密码登录×
登录注册×
其他方式登录
点击 登录注册 即表示同意《亿速云用户服务条款》

lifecycle功能测试方法是什么

发布时间:2021-12-30 16:38:46 来源:亿速云 阅读:106 作者:iii 栏目:云计算

本篇内容主要讲解“lifecycle功能测试方法是什么”,感兴趣的朋友不妨来看看。本文介绍的方法操作简单快捷,实用性强。下面就让小编来带大家学习“lifecycle功能测试方法是什么”吧!

lifecycle功能测试

功能描述:
1.目前从k版本开始支持lifecycle,且仅支持Expired,既过期对象删除。
2.AWS4认证下无法进行lifecycle的修改操作,HTTP层面会出现501错误。
3.boto和boto3可以支持AWS2认证下的get和put操作,测试功能可用。
4.测试发现先对bucket进行get_lifecycle操作,如果返回404,则对应的response的内容不完整,之后的一次request请求中的response会被污染。

get_bucket_lifecycle 测试用例
boto3用例
import boto3
from botocore.client import Config

aws_access_key_id = ''
aws_secret_access_key = ''
bucket_name = 'test1'

# aws4
s3 = boto3.client('s3', region_name='CN',
                  use_ssl=False,
                  endpoint_url='http://ceph.work',
                  aws_access_key_id=aws_access_key_id,
                  aws_secret_access_key=aws_secret_access_key,
                  config=Config(signature_version='s3v4',
                                s3={'addressing_style': 'virtual'}))

# aws2
s3 = boto3.client('s3', region_name=None,
                  use_ssl=False,
                  endpoint_url='http://ceph.work',
                  aws_access_key_id=aws_access_key_id,
                  aws_secret_access_key=aws_secret_access_key,
                  config=Config(s3={'addressing_style': 'virtual'}))


print s3.get_bucket_lifecycle(Bucket=bucket_name)
print s3.get_bucket_lifecycle_configuration(Bucket=bucket_name)
boto用例
from boto.s3.connection import S3Connection
import boto

# import os
# os.environ['S3_USE_SIGV4'] = 'True' #use aws4


access_key = ''
secret_key = ''
host = 'ceph.work'
bucket_name = 'test1'

conn = boto.connect_s3(
    aws_access_key_id=access_key,
    aws_secret_access_key=secret_key,
    host=host,
    is_secure=False,
    calling_format=boto.s3.connection.SubdomainCallingFormat(),
    validate_certs=True,
)

bucket = conn.get_bucket(bucket_name)
config = bucket.get_lifecycle_config()
for i in config:
    print i.endElement
    print i.expiration
    print i.id
    print i.startElement
    print i.to_xml()
put_bucket_lifecycle 测试用例
boto3用例
import boto3
from botocore.client import Config
import datetime

aws_access_key_id = ''
aws_secret_access_key = ''
bucket_name = 'test1'

#aws2 可用
s3 = boto3.client('s3', region_name=None,
                  use_ssl=False,
                  endpoint_url='http://ceph.work',
                  aws_access_key_id=aws_access_key_id,
                  aws_secret_access_key=aws_secret_access_key,
                  config=Config(s3={'addressing_style': 'virtual'}))


#aws4 错误,返回501
s3 = boto3.client('s3', region_name='CN',
                  use_ssl=False,
                  endpoint_url='http://ceph.work',
                  aws_access_key_id=aws_access_key_id,
                  aws_secret_access_key=aws_secret_access_key,
                  config=Config(signature_version='s3v4',
                                s3={'addressing_style': 'virtual'}))

print s3.put_bucket_lifecycle(
    Bucket=bucket_name,
    LifecycleConfiguration={
        'Rules': [
            {
                'Expiration': {
                    'Date': datetime.datetime(2015, 3, 15),
                    'Days': 123,
                    'ExpiredObjectDeleteMarker': True|False
                },
                'ID': 'demo1',
                'Prefix': '/abc',
                'Status': 'Enabled',
                'Transition': {
                    'Date': datetime.datetime(2017, 3, 15),
                    'Days': 123,
                    'StorageClass': 'STANDARD_IA'
                },
                'NoncurrentVersionTransition': {
                    'NoncurrentDays': 123,
                    'StorageClass': 'STANDARD_IA'
                },
                'NoncurrentVersionExpiration': {
                    'NoncurrentDays': 123
                },
                'AbortIncompleteMultipartUpload': {
                    'DaysAfterInitiation': 123
                }
            },
        ]
    }
)

501错误提示,应该是官方还没完成该部分特性。

<?xml version="1.0" encoding="UTF-8"?><Error><Code>NotImplemented</Code><RequestId>tx000000000000000000056-0058d0d70b-10b2-default</RequestId><HostId>10b2-default-default</HostId></Error>
boto用例
from boto.s3.connection import S3Connection
import boto
import boto.s3.lifecycle
import os
# os.environ['S3_USE_SIGV4'] = 'True' #use aws4

from boto.s3.lifecycle import (
    Lifecycle,
    Expiration,
)

access_key = ''
secret_key = ''
host = 'ceph.work'
bucket_name = 'test1'

conn = boto.connect_s3(
    aws_access_key_id=access_key,
    aws_secret_access_key=secret_key,
    host=host,
    is_secure=False,
    calling_format=boto.s3.connection.SubdomainCallingFormat(),
    validate_certs=True,
)
bucket = conn.get_bucket(bucket_name)

#type 1
lifecycle_config = boto.s3.lifecycle.Lifecycle()
lifecycle_config.add_rule('lc_rule_1', 'del/', 'Enabled', 1)
lifecycle_config.add_rule('lc_rule_2', '/abc', 'Enabled', 10)
bucket.configure_lifecycle(lifecycle_config)


#type 2
lifecycle = Lifecycle()
lifecycle.add_rule('lc_rule_1', prefix='del/', status='Enable', expiration=Expiration(days=1))
lifecycle.add_rule('lc_rule_2', prefix='data/', status='Enabled', expiration=Expiration(days=10))
bucket.configure_lifecycle(lifecycle)

get_bucket_lifecycled的bug

from boto.s3.connection import S3Connection
import boto

access_key = ''
secret_key = ''
host = 'ceph.work'
bucket_name = 'test1'

conn = boto.connect_s3(
    aws_access_key_id=access_key,
    aws_secret_access_key=secret_key,
    host=host,
    is_secure=False,
    calling_format=boto.s3.connection.SubdomainCallingFormat(),
    validate_certs=True,
)

bucket = conn.get_bucket(bucket_name)
print bucket.get_lifecycle_config() #未设置bucket的lifecycle,返回404,报以下错误

错误提示

Traceback (most recent call last):
  File "/Users/Diluga/SourceCode/PycharmProjects/kv_server/boto_demo/demo1.py", line 56, in <module>
    print bucket.get_lifecycle_config()
  File "/Users/Diluga/lwc/lib/python2.7/site-packages/boto/s3/bucket.py", line 1387, in get_lifecycle_config
    response.status, response.reason, body)
boto.exception.S3ResponseError: S3ResponseError: 404 Not Found
<?xml version="1.0" encoding="UTF-8"?><Error><Code>NoSuchLifecycleConfiguration</Code><BucketName>snappy-test</BucketName><RequestId>tx00000000000000000008f-0058d0dc3b-10b2-default</RequestId><HostId>10b2-default-default</HostId></Error>
#xml未结束,下一个request请求所返回的response会被污染

s3cmd同样报错

DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': 'AWS4-HMAC-SHA256 Credential=W7L3YC842AGADI1T8BV9/20170321/CN/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=d0a6ca337af207d00d170f5bb999782f49928b01395494c96d3dd31f88d987c7', 'x-amz-date': '20170321T075840Z'}
DEBUG: Processing request, please wait...
DEBUG: get_hostname(snappy-test): snappy-test.ceph.work
DEBUG: ConnMan.get(): re-using connection: http://snappy-test.ceph.work#2
DEBUG: format_uri(): /?lifecycle
DEBUG: Sending request method_string='GET', uri='/?lifecycle', headers={'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': 'AWS4-HMAC-SHA256 Credential=W7L3YC842AGADI1T8BV9/20170321/CN/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=d0a6ca337af207d00d170f5bb999782f49928b01395494c96d3dd31f88d987c7', 'x-amz-date': '20170321T075840Z'}, body=(0 bytes)
DEBUG: Response: {'status': 404, 'headers': {'date': 'Tue, 21 Mar 2017 07:58:40 GMT', 'content-length': '237', 'x-amz-request-id': 'tx000000000000000000092-0058d0dd30-10b2-default', 'content-type': 'application/xml', 'accept-ranges': 'bytes'}, 'reason': 'Not Found', 'data': '<?xml version="1.0" encoding="UTF-8"?><Error><Code>NoSuchLifecycleConfiguration</Code><BucketName>snappy-test</BucketName><RequestId>tx000000000000000000092-0058d0dd30-10b2-default</RequestId><HostId>10b2-default-default</HostId></Error>'}
DEBUG: ConnMan.put(): connection put back to pool (http://snappy-test.ceph.work#3)
DEBUG: S3Error: 404 (Not Found)
DEBUG: HttpHeader: date: Tue, 21 Mar 2017 07:58:40 GMT
DEBUG: HttpHeader: content-length: 237
DEBUG: HttpHeader: x-amz-request-id: tx000000000000000000092-0058d0dd30-10b2-default
DEBUG: HttpHeader: content-type: application/xml
DEBUG: HttpHeader: accept-ranges: bytes
DEBUG: ErrorXML: Code: 'NoSuchLifecycleConfiguration'
DEBUG: ErrorXML: BucketName: 'snappy-test'
DEBUG: ErrorXML: RequestId: 'tx000000000000000000092-0058d0dd30-10b2-default'
DEBUG: ErrorXML: HostId: '10b2-default-default'
DEBUG: Could not get /?lifecycle - lifecycle probably not configured for this bucket
   Expiration Rule: none
DEBUG: CreateRequest: resource[uri]=/?acl
DEBUG: Using signature v4
DEBUG: get_hostname(snappy-test): snappy-test.ceph.work
DEBUG: canonical_headers = host:snappy-test.ceph.work
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20170321T075840Z

DEBUG: Canonical Request:
GET
/
acl=
host:snappy-test.ceph.work
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20170321T075840Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
----------------------
DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': 'AWS4-HMAC-SHA256 Credential=W7L3YC842AGADI1T8BV9/20170321/CN/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=03386b844b8600b0cdd28d38d8a6e528fa75385cab056771f9148266905a33dd', 'x-amz-date': '20170321T075840Z'}
DEBUG: Processing request, please wait...
DEBUG: get_hostname(snappy-test): snappy-test.ceph.work
DEBUG: ConnMan.get(): re-using connection: http://snappy-test.ceph.work#3
DEBUG: format_uri(): /?acl
DEBUG: Sending request method_string='GET', uri='/?acl', headers={'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': 'AWS4-HMAC-SHA256 Credential=W7L3YC842AGADI1T8BV9/20170321/CN/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=03386b844b8600b0cdd28d38d8a6e528fa75385cab056771f9148266905a33dd', 'x-amz-date': '20170321T075840Z'}, body=(0 bytes)
DEBUG: Response: {'status': 200, 'headers': {}, 'reason': '', 'data': '<LifecycleConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/"></LifecycleConfiguration>HTTP/1.1 200 OK\r\nx-amz-request-id: tx000000000000000000093-0058d0dd30-10b2-default\r\nContent-Type: application/xml\r\nContent-Length: 441\r\nDate: Tue, 21 Mar 2017 07:58:40 GMT\r\n\r\n<?xml version="1.0" encoding="UTF-8"?><AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>u-gfn2636</ID><DisplayName>u-gfn2636</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>u-gfn2636</ID><DisplayName>u-gfn2636</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>'}
DEBUG: ConnMan.put(): connection put back to pool (http://snappy-test.ceph.work#4)
ERROR: Error parsing xml: not well-formed (invalid token): line 1, column 101
ERROR: <LifecycleConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/"></LifecycleConfiguration>HTTP/1.1 200 OK
x-amz-request-id: tx000000000000000000093-0058d0dd30-10b2-default
Content-Type: application/xml
Content-Length: 441
Date: Tue, 21 Mar 2017 07:58:40 GMT

<?xml version="1.0" encoding="UTF-8"?><AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>u-gfn2636</ID><DisplayName>u-gfn2636</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>u-gfn2636</ID><DisplayName>u-gfn2636</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>

到此,相信大家对“lifecycle功能测试方法是什么”有了更深的了解,不妨来实际操作一番吧!这里是亿速云网站,更多相关内容可以进入相关频道进行查询,关注我们,继续学习!

向AI问一下细节

免责声明:本站发布的内容(图片、视频和文字)以原创、转载和分享为主,文章观点不代表本网站立场,如果涉及侵权请联系站长邮箱:is@yisu.com进行举报,并提供相关证据,一经查实,将立刻删除涉嫌侵权内容。

AI