From patchwork Thu Jun 23 16:07:52 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Igor Fedotov X-Patchwork-Id: 9195533 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 2C4E46077D for ; Thu, 23 Jun 2016 16:08:58 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 1C36B2845C for ; Thu, 23 Jun 2016 16:08:58 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 1104528464; Thu, 23 Jun 2016 16:08:58 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.8 required=2.0 tests=BAYES_00,DKIM_SIGNED, RCVD_IN_DNSWL_HI,T_DKIM_INVALID autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 19FAF2845D for ; Thu, 23 Jun 2016 16:08:57 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751054AbcFWQIx (ORCPT ); Thu, 23 Jun 2016 12:08:53 -0400 Received: from mail-lf0-f44.google.com ([209.85.215.44]:34024 "EHLO mail-lf0-f44.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750876AbcFWQIB (ORCPT ); Thu, 23 Jun 2016 12:08:01 -0400 Received: by mail-lf0-f44.google.com with SMTP id h129so99232552lfh.1 for ; Thu, 23 Jun 2016 09:07:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mirantis.com; s=google; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=3yoNa9oryqExoItLAjC8rnmaDHfOYgf2sOpyGchcIRo=; b=jt9Z3XDnhogZWxQP0q1u2CKURxIJ7u9QhHteAeNMWdUq0lLxvf/qI6fwbt3uVU2pgY Onv1Alr9jVEH+HsaUcL2MKtbFYOV4/FG2cKWsXyMbylSiNou4DMTVEnXDAc8OoiubqRt 5OPJB854UN9krFn1h8/WdnstwoB/P/8LNGnrc= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=3yoNa9oryqExoItLAjC8rnmaDHfOYgf2sOpyGchcIRo=; b=YesXdcwnjh3NoDA3tHFcX6ZhARHFfk5caiJDo6/FjfytBfzRU278siTIt1p5XQrMqN Spt84g6kTEGk43ZZIhU4hJaZp2y3OxfgJFa6GzbYaAzMMy+qqANgRAzsMTw+KQ69J4MA Eaj0WZ8UYCbGVDH4juAkzpAB3q06K4+AmAfCYKr6RSwKyQ5cKPFGhfU98+sP+qqrV6Za XIToEKpAX2ADS91hJs9N9dRzwDDjc35i8qVsWChU6s2JIzrMXfc3lbiINQE2kY/TTkWU cH/QziO4VajvmBFFVEemtkmUzayTMlHtX2IFYSfSFCrk/CMIwbrB+gELtc+av/M52nJQ ueDw== X-Gm-Message-State: ALyK8tJ5wc549aWe6rNa7RgzoQIO11jTintB0xMmWVesbuKK/Bq8lBzKwbTCZm61wz444VEQ X-Received: by 10.25.27.21 with SMTP id b21mr8528690lfb.171.1466698073685; Thu, 23 Jun 2016 09:07:53 -0700 (PDT) Received: from [127.0.0.1] ([91.218.144.129]) by smtp.googlemail.com with ESMTPSA id 204sm156338ljf.6.2016.06.23.09.07.52 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 23 Jun 2016 09:07:52 -0700 (PDT) Subject: Re: issue in ceph_test_objectstore To: Ramesh Chander , ceph-devel References: From: Igor Fedotov Message-ID: Date: Thu, 23 Jun 2016 19:07:52 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 In-Reply-To: Sender: ceph-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: ceph-devel@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Ramesh, This relates to the topic raised here yesterday - see "plugin infra issues" topic. The question is still open though. The workaround I use is to create a conf file and set "plugin dir" to '.libs": [global] ... plugin dir = .libs if (!library) { On 23.06.2016 18:53, Ramesh Chander wrote: > I am hitting this issue when running ceph_test_objectstore with bluestore without bluefs. > > Known issue or something wrong in configuration? > > One suspicion is error of not able to find libsnappy. > > ---------------------------------- > > > 2016-06-23 21:20:01.340312 7ffff7fdd680 1 bluestore(store_test_temp_dir) _open_db opened rocksdb path store_test_temp_dir/db options compression=kNoCompression,max_write_buffer_number=16,min_write_buffer_number_to_merge=3,recycle_log_file_num=16 > 2016-06-23 21:20:01.340367 7ffff7fdd680 1 freelist init > [New Thread 0x7fffe2ffd700 (LWP 30859)] > 2016-06-23 21:20:01.341445 7ffff35ac700 -1 bdev(store_test_temp_dir/block) _aio_thread got (4) Interrupted system call > [New Thread 0x7fffe37fe700 (LWP 30860)] > 2016-06-23 21:20:01.342552 7ffff35ac700 -1 bdev(store_test_temp_dir/block) _aio_thread got (4) Interrupted system call > 2016-06-23 21:20:01.342624 7ffff7fdd680 -1 load failed dlopen(/usr/local/lib/ceph/compressor/libceph_snappy.so): /usr/local/lib/ceph/compressor/libceph_snappy.so: cannot open shared object file: No such file or directory > Creating collection meta > 2016-06-23 21:20:01.342633 7ffff7fdd680 -1 create cannot load compressor of type snappy > 2016-06-23 21:20:01.342634 7ffff7fdd680 -1 bluestore(store_test_temp_dir) _set_compression unable to initialize snappy compressor > Creating object #-1:68309cac:::Object 1:head# > Remove then create > Remove then create > Append Full overwrite > Partial overwrite > 00000000 61 62 63 61 62 63 64 65 64 65 |abcabcdede| > 0000000a > Truncate + hole > Reverse fill-in > 00000000 61 62 63 64 65 66 67 68 69 6a |abcdefghij| > 0000000a > larger overwrite > 00000000 61 62 63 64 65 30 31 32 33 34 30 31 32 33 34 30 |abcde01234012340| > 00000010 31 32 33 34 30 31 32 33 34 61 62 63 64 65 30 31 |123401234abcde01| > 00000020 32 33 34 30 31 32 33 34 30 31 32 33 34 30 31 32 |2340123401234012| > 00000030 33 34 61 62 63 64 65 30 31 32 33 34 30 31 32 33 |34abcde012340123| > 00000040 34 30 31 32 33 34 30 31 32 33 34 61 62 63 64 65 |40123401234abcde| > 00000050 30 31 32 33 34 30 31 32 33 34 30 31 32 33 34 30 |0123401234012340| > 00000060 31 32 33 34 |1234| > 00000064 > 00000000 61 62 63 64 65 30 31 32 33 34 30 31 32 33 34 30 |abcde01234012340| > 00000010 31 32 33 34 30 31 32 33 34 61 62 63 64 65 30 31 |123401234abcde01| > 00000020 32 33 34 30 31 32 33 34 30 31 32 33 34 30 31 32 |2340123401234012| > 00000030 33 34 61 62 63 64 65 30 31 32 33 34 30 31 32 33 |34abcde012340123| > 00000040 34 30 31 32 33 34 30 31 32 33 34 61 62 63 64 65 |40123401234abcde| > 00000050 30 31 32 33 34 30 31 32 33 34 30 31 32 33 34 30 |0123401234012340| > 00000060 31 32 33 34 |1234| > 00000064 > > Write unaligned csum, stage 2 > Cleaning > 2016-06-23 21:20:01.351634 7ffff7fdd680 1 bluestore(store_test_temp_dir) umount > > Program received signal SIGFPE, Arithmetic exception. > [Switching to Thread 0x7fffe37fe700 (LWP 30860)] > 0x0000555555879b00 in BlueStore::TwoQCache::trim (this=0x55555e428ab0, onode_max=500, buffer_max=2000000) at os/bluestore/BlueStore.cc:674 > 674 uint64_t kin = buffer_max / avg_buffer_size / 2; > (gdb) bt > #0 0x0000555555879b00 in BlueStore::TwoQCache::trim (this=0x55555e428ab0, onode_max=500, buffer_max=2000000) at os/bluestore/BlueStore.cc:674 > #1 0x000055555585b4fd in BlueStore::_osr_reap_done (this=this@entry=0x55555e428f40, osr=osr@entry=0x55555e327d30) at os/bluestore/BlueStore.cc:4672 > #2 0x0000555555861c44 in BlueStore::_txc_finish (this=this@entry=0x55555e428f40, txc=txc@entry=0x55555e44c8b0) at os/bluestore/BlueStore.cc:4642 > #3 0x0000555555871d1a in BlueStore::_txc_state_proc (this=this@entry=0x55555e428f40, txc=0x55555e44c8b0) at os/bluestore/BlueStore.cc:4499 > #4 0x000055555587de4f in BlueStore::_kv_sync_thread (this=0x55555e428f40) at os/bluestore/BlueStore.cc:4816 > #5 0x00005555558abcbd in BlueStore::KVSyncThread::entry (this=) at os/bluestore/BlueStore.h:1120 > #6 0x00007ffff64b2182 in start_thread (arg=0x7fffe37fe700) at pthread_create.c:312 > #7 0x00007ffff4ccf47d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 > > > > -Regards, > Ramesh Chander > > PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies). > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html --- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ================================= and apply the patch below: diff --git a/src/common/PluginRegistry.cc b/src/common/PluginRegistry.cc index fb02d4a..f527940 100644 --- a/src/common/PluginRegistry.cc +++ b/src/common/PluginRegistry.cc @@ -138,7 +138,7 @@ int PluginRegistry::load(const std::string &type, assert(lock.is_locked()); ldout(cct, 1) << __func__ << " " << type << " " << name << dendl; - std::string fname = cct->_conf->plugin_dir + "/" + type + "/" PLUGIN_PREFIX + std::string fname = cct->_conf->plugin_dir + "/" + PLUGIN_PREFIX + name + PLUGIN_SUFFIX; void *library = dlopen(fname.c_str(), RTLD_NOW);