o OjbY@sddlZddlZddlmZddlmZddlmZddlm Z m Z m Z m Z ddl mZmZmZmZGddde ZGd d d e ZGd d d e ZGd dde ZdS)N) parse_qsl) ClientError)S3CopyFailedError)CompleteMultipartUploadTaskCreateMultipartUploadTaskSubmissionTaskTask)ChunksizeAdjustercalculate_range_parameter get_callbacksget_filtered_dictc @seZdZdZdddddddd d d Zgd Zgd ZgdZgdZd d gZ gdZ d d gZ d d gZ gdZ ddZddZ  d$ddZddZddZddZddZd d!Zd"d#ZdS)%CopySubmissionTaskz+Task for submitting tasks to execute a copyIfMatchIfModifiedSince IfNoneMatchIfUnmodifiedSinceSSECustomerKeySSECustomerAlgorithmSSECustomerKeyMD5 RequestPayerExpectedBucketOwner) CopySourceIfMatchCopySourceIfModifiedSinceCopySourceIfNoneMatchCopySourceIfUnmodifiedSinceCopySourceSSECustomerKeyCopySourceSSECustomerAlgorithmCopySourceSSECustomerKeyMD5rr) rrrrrrrrrrrr) rrrrrrrMetadataDirectiveTaggingDirectiveAnnotationDirectiveTagging) CacheControlContentDispositionContentEncodingContentLanguage ContentTypeExpiresMetadata)rrrrr)rrChecksumAlgorithmc Csi}d}|jj}|jjdus|jjdurV||j} |j} | D]\} } | |jvr1| | |j| <q!|j j di| } |j | d|j | d|| }| d}|jj|jkrh||||||dS|j|||||||ddS)a :param client: The client associated with the transfer manager :type config: s3transfer.manager.TransferConfig :param config: The transfer config associated with the transfer manager :type osutil: s3transfer.utils.OSUtil :param osutil: The os utility associated to the transfer manager :type request_executor: s3transfer.futures.BoundedExecutor :param request_executor: The request executor associated with the transfer manager :type transfer_future: s3transfer.futures.TransferFuture :param transfer_future: The transfer future associated with the transfer request that tasks are being submitted for N ContentLengthETag VersionId)source_version_id)meta call_argssizeetag)_get_head_object_request_from_copy_source copy_source extra_argsitemsEXTRA_ARGS_TO_HEAD_ARGS_MAPPING source_client head_objectprovide_transfer_sizeprovide_object_etagget_extract_preserved_metadatamultipart_threshold_submit_copy_request_submit_multipart_request)selfclientconfigosutilrequest_executortransfer_futurepreserved_metadatar-r0head_object_requestr5paramvalueresponser.r.W/var/www/html/pharmsmart-cdr-gen/venv/lib/python3.10/site-packages/s3transfer/copies.py_submitosR         zCopySubmissionTask._submitc CsL|jj}t|d}|j|t|j||j|j|j|j ||jj ddddS)Nprogress)rBr4bucketkeyr5 callbacksr1T)transfer_coordinator main_kwargsis_final) r/r0r _transfer_coordinatorsubmitCopyObjectTaskr4rOrPr5r1)rArBrCrDrErFr0progress_callbacksr.r.rLr?s"  z'CopySubmissionTask._submit_copy_requestNcCs|jj}||j|p i} i} | D] \} } | |jvr | | | <q|j|t|j||j |j | dd} |j }t }| ||jj}tt|jjt|}g}t|d}td|dD]R}||j}t||d||jj|d<|jjdur~|jj|d<|||d||jj}|jd}||j|t|j||j|j |j |||||d d | id q]||j}|j|t|j||j |j |||d | |d d ddS)N)rBrOrPr5)rRrSrNCopySourceRangerr)) rBr4rOrP part_numberr5rQr1checksum_algorithm upload_id)rRrSpending_main_kwargs)rBrOrPr5r0r-)r]partsT)rRrSr^rT)r/r0_apply_preserved_metadatar5r6CREATE_MULTIPART_ARGS_BLACKLISTrUrVrrOrPmultipart_chunksizer adjust_chunksizer1intmathceilfloatr range_extra_upload_part_argsr r2_get_transfer_sizer<append CopyPartTaskr4_extra_complete_multipart_argsCopyCompleteMultipartUploadTask)rArBrCrDrErFrGr-r0merged_extra_argscreate_multipart_extra_argsrIvalcreate_multipart_future part_sizeadjuster num_parts part_futuresrXr[extra_part_argsr1r\complete_multipart_extra_argsr.r.rLr@s        z,CopySubmissionTask._submit_multipart_requestcCs(i}|jD] }||vr||||<q|SNPRESERVED_METADATA_FIELDS)rAhead_object_response preservedfieldr.r.rLr=Us   z.CopySubmissionTask._extract_preserved_metadatacs6|ddkr |Sfdd|D}|||S)NrREPLACEcs i|] \}}|jvr||qSr.rz.0kvrAr.rL bs z@CopySubmissionTask._apply_preserved_metadata..)r<r6update)rAr5rGresultr.rrLr`\s  z,CopySubmissionTask._apply_preserved_metadatacCs.t|tr t|Std|dt|d)NzLExpecting dictionary formatted: {"Bucket": bucket_name, "Key": key} but got z or type .) isinstancedictcopy TypeErrortype)rAr4r.r.rLr3is  zsz?CopyCompleteMultipartUploadTask._apply_tags..r!T)keep_blank_values)rrr!r.) r5r<r4r r rr8get_object_taggingrrOrPrput_object_tagging) rArBr0r-rr5 directive src_kwargstag_set put_kwargsr.r.rLrsL   z+CopyCompleteMultipartUploadTask._apply_tagsc Csv|j}|ddkr dS|jd|jdd}|r||d<i|t|tj}i|t|tj} t|tj} |jj di|} g} i} | dgD]S}|d}|jj di| d|i}|j |j ||d  d | }|rr||d<|rx||d <z|jdi|| |WqJty}z || |<WYd}~qJd}~ww| rtd |j d |j d| dt| d| dS)Nr rrrrr, AnnotationsAnnotationNameAnnotationPayload)rrrr ObjectIfMatchz#Failed to copy annotations to s3:///z . Succeeded: z . Failed: z . Errors: r.)r5r<r4r r rrrr8list_object_annotationsget_object_annotationrOrPreadput_object_annotationrk Exceptionrlistkeys)rArBr0r-rrr5src_base list_kwargsget_kwargs_baseput_passthrough list_response succeededfailed annotationnamepayload_responserer.r.rLrs     z2CopyCompleteMultipartUploadTask._apply_annotationsN)rrrrrrrr.r.r.rLrns  (rnc@seZdZdZddZdS)rWzTask to do a nonmultipart copyc Cs0|jd|||d||D]}||dqdS)a :param client: The client to use when calling PutObject :param copy_source: The CopySource parameter to use :param bucket: The name of the bucket to copy to :param key: The name of the key to copy to :param extra_args: A dictionary of any extra arguments that may be used in the upload. :param callbacks: List of callbacks to call after copy :param size: The size of the transfer. This value is passed into the callbacks ) CopySourcerrbytes_transferredNr.) copy_object) rArBr4rOrPr5rQr1callbackr.r.rLrs zCopyObjectTask._mainNrrrrrr.r.r.rLrWs rWc@seZdZdZ dddZdS)rlz)Task to upload a part in a multipart copyNc  Csz|jd|||||d|} Wn.ty>} z"| jdid} |d}|d}| dkr9td|d|d d } ~ ww|D]}|| d qA| d d }||d}| rkd| }|| d vrk| d |||<|S)a< :param client: The client to use when calling PutObject :param copy_source: The CopySource parameter to use :param bucket: The name of the bucket to upload to :param key: The name of the key to upload to :param upload_id: The id of the upload :param part_number: The number representing the part of the multipart upload :param extra_args: A dictionary of any extra arguments that may be used in the upload. :param callbacks: List of callbacks to call after copy part :param size: The size of the transfer. This value is passed into the callbacks :param checksum_algorithm: The algorithm that was used to create the multipart upload :rtype: dict :returns: A dictionary representing a part:: {'Etag': etag_value, 'PartNumber': part_number} This value can be appended to a list to be used to complete the multipart upload. If a checksum is in the response, it will also be included. )rrrr PartNumberErrorCoderrPreconditionFailedzContents of stored object "z " in bucket "z" did not match expected ETag.NrCopyPartResultr+)r+rChecksumr.)upload_part_copyrrKr<rupper)rArBr4rOrPr]r[r5rQr1r\rKr error_codesrc_key src_bucketrr2 part_metadatachecksum_memberr.r.rLr/sD&     zCopyPartTask._mainryrr.r.r.rLrl,s rl)rre urllib.parserbotocore.exceptionsrs3transfer.exceptionsrs3transfer.tasksrrrrs3transfer.utilsr r r r r rnrWrlr.r.r.rLs    e