From patchwork Wed Feb 15 16:14:19 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Alan Tull X-Patchwork-Id: 9574379 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 5BE5860493 for ; Wed, 15 Feb 2017 16:15:03 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 454992846B for ; Wed, 15 Feb 2017 16:15:03 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 39CED28489; Wed, 15 Feb 2017 16:15:03 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=2.0 tests=BAYES_00,RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 2DF2028487 for ; Wed, 15 Feb 2017 16:15:01 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751999AbdBOQO5 (ORCPT ); Wed, 15 Feb 2017 11:14:57 -0500 Received: from mail.kernel.org ([198.145.29.136]:51864 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751953AbdBOQOx (ORCPT ); Wed, 15 Feb 2017 11:14:53 -0500 Received: from mail.kernel.org (localhost [127.0.0.1]) by mail.kernel.org (Postfix) with ESMTP id D8D9D20303; Wed, 15 Feb 2017 16:14:44 +0000 (UTC) Received: from localhost.localdomain (user-0ccsrjt.cable.mindspring.com [24.206.110.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 6EC04202F0; Wed, 15 Feb 2017 16:14:40 +0000 (UTC) From: Alan Tull To: Moritz Fischer , Jason Gunthorpe Cc: Alan Tull , linux-kernel@vger.kernel.org, linux-fpga@vger.kernel.org Subject: [RFC 6/8] fpga-region: separate out common code to allow non-dt support Date: Wed, 15 Feb 2017 10:14:19 -0600 Message-Id: <1487175261-7051-7-git-send-email-atull@kernel.org> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1487175261-7051-1-git-send-email-atull@kernel.org> References: <1487175261-7051-1-git-send-email-atull@kernel.org> X-Virus-Scanned: ClamAV using ClamSMTP Sender: linux-fpga-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-fpga@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP FPGA region is a layer above the FPGA manager and FPGA bridge frameworks that controls them both together. The current implementation for FPGA regions is dependent on device tree. This commit separates that code into common code and device tree specific code. fpga-region.c remains as common code and of-fpga-region.c is added to support device tree overlays. Functons exported: of_fpga_region_find * Find a fpga region, given the node pointer fpga_region_alloc_image_info fpga_region_free_image_info * Alloc/free fpga_image_info struct fpga_region_program_fpga * Program an FPGA region * fpga_region_register * fpga_region_unregister Create/remove a FPGA region. Caller will supply the region struct initialized with a pointer to a FPGA manager and a method to get the FPGA bridges. Signed-off-by: Alan Tull --- drivers/fpga/Kconfig | 12 +- drivers/fpga/Makefile | 1 + drivers/fpga/fpga-region.c | 558 +++++++----------------------------------- drivers/fpga/fpga-region.h | 68 +++++ drivers/fpga/of-fpga-region.c | 510 ++++++++++++++++++++++++++++++++++++++ include/linux/fpga/fpga-mgr.h | 6 +- 6 files changed, 678 insertions(+), 477 deletions(-) create mode 100644 drivers/fpga/fpga-region.h create mode 100644 drivers/fpga/of-fpga-region.c diff --git a/drivers/fpga/Kconfig b/drivers/fpga/Kconfig index ce861a2..be9c23d 100644 --- a/drivers/fpga/Kconfig +++ b/drivers/fpga/Kconfig @@ -15,10 +15,18 @@ if FPGA config FPGA_REGION tristate "FPGA Region" - depends on OF && FPGA_BRIDGE + depends on FPGA_BRIDGE + help + FPGA Region common code. A FPGA Region controls a FPGA Manager + and the FPGA Bridges associated with either a reconfigurable + region of an FPGA or a whole FPGA. + +config OF_FPGA_REGION + tristate "FPGA Region Device Tree Overlay Support" + depends on FPGA_REGION help FPGA Regions allow loading FPGA images under control of - the Device Tree. + Device Tree Overlays. config FPGA_MGR_SOCFPGA tristate "Altera SOCFPGA FPGA Manager" diff --git a/drivers/fpga/Makefile b/drivers/fpga/Makefile index 8df07bc..fb88fb0 100644 --- a/drivers/fpga/Makefile +++ b/drivers/fpga/Makefile @@ -17,3 +17,4 @@ obj-$(CONFIG_ALTERA_FREEZE_BRIDGE) += altera-freeze-bridge.o # High Level Interfaces obj-$(CONFIG_FPGA_REGION) += fpga-region.o +obj-$(CONFIG_OF_FPGA_REGION) += of-fpga-region.o diff --git a/drivers/fpga/fpga-region.c b/drivers/fpga/fpga-region.c index a5d8112..5690237 100644 --- a/drivers/fpga/fpga-region.c +++ b/drivers/fpga/fpga-region.c @@ -22,64 +22,58 @@ #include #include #include -#include #include #include +#include "fpga-region.h" -/** - * struct fpga_region - FPGA Region structure - * @dev: FPGA Region device - * @mutex: enforces exclusive reference to region - * @bridge_list: list of FPGA bridges specified in region - * @overlays: list of struct region_overlay_info - */ -struct fpga_region { - struct device dev; - struct mutex mutex; /* for exclusive reference to region */ - struct list_head bridge_list; - struct list_head overlays; -}; +static DEFINE_IDA(fpga_region_ida); +struct class *fpga_region_class; -/** - * struct region_overlay: info regarding overlays applied to the region - * @node: list node - * @overlay: pointer to overlay - * @image_info: fpga image specific information parsed from overlay. Is NULL if - * overlay doesn't program FPGA. - */ +/* todo: prevent programming parent region */ -struct region_overlay { - struct list_head node; - struct device_node *overlay; +struct fpga_image_info *fpga_region_alloc_image_info(struct fpga_region *region) +{ + struct device *dev = ®ion->dev; struct fpga_image_info *image_info; -}; -/* Lock for list of overlays */ -spinlock_t overlay_list_lock; + image_info = devm_kzalloc(dev, sizeof(*image_info), GFP_KERNEL); + if (!image_info) + return ERR_PTR(-ENOMEM); -#define to_fpga_region(d) container_of(d, struct fpga_region, dev) + return image_info; +} +EXPORT_SYMBOL_GPL(fpga_region_alloc_image_info); -static DEFINE_IDA(fpga_region_ida); -static struct class *fpga_region_class; +void fpga_region_free_image_info(struct fpga_region *region, + struct fpga_image_info *image_info) +{ + struct device *dev = ®ion->dev; -static const struct of_device_id fpga_region_of_match[] = { - { .compatible = "fpga-region", }, - {}, -}; -MODULE_DEVICE_TABLE(of, fpga_region_of_match); + if (!image_info) + return; + if (image_info->firmware_name) + devm_kfree(dev, image_info->firmware_name); + + devm_kfree(dev, image_info); +} +EXPORT_SYMBOL_GPL(fpga_region_free_image_info); + +#if IS_ENABLED(CONFIG_OF_FPGA_REGION) static int fpga_region_of_node_match(struct device *dev, const void *data) { return dev->of_node == data; } /** - * fpga_region_find - find FPGA region + * of_fpga_region_find - find FPGA region * @np: device node of FPGA Region + * * Caller will need to put_device(®ion->dev) when done. + * * Returns FPGA Region struct or NULL */ -static struct fpga_region *fpga_region_find(struct device_node *np) +struct fpga_region *of_fpga_region_find(struct device_node *np) { struct device *dev; @@ -90,6 +84,26 @@ static struct fpga_region *fpga_region_find(struct device_node *np) return to_fpga_region(dev); } +EXPORT_SYMBOL_GPL(of_fpga_region_find); + +/* + * If a region has overlays, only the first overlay can program the FPGA + * so only the first overlay will have image info. + */ +struct fpga_image_info *fpga_region_ovl_image_info(struct fpga_region *region) +{ + struct region_overlay *reg_ovl; + + if (list_empty(®ion->overlays)) + return NULL; + + reg_ovl = list_first_entry(®ion->overlays, typeof(*reg_ovl), node); + + return reg_ovl->image_info; +} +EXPORT_SYMBOL_GPL(fpga_region_ovl_image_info); + +#endif /* CONFIG_OF_FPGA_REGION */ /** * fpga_region_get - get an exclusive reference to a fpga region @@ -111,9 +125,7 @@ static struct fpga_region *fpga_region_get(struct fpga_region *region) } get_device(dev); - of_node_get(dev->of_node); if (!try_module_get(dev->parent->driver->owner)) { - of_node_put(dev->of_node); put_device(dev); mutex_unlock(®ion->mutex); return ERR_PTR(-ENODEV); @@ -136,109 +148,11 @@ static void fpga_region_put(struct fpga_region *region) dev_dbg(®ion->dev, "put\n"); module_put(dev->parent->driver->owner); - of_node_put(dev->of_node); put_device(dev); mutex_unlock(®ion->mutex); } /** - * fpga_region_get_manager - get reference for FPGA manager - * @region: FPGA region - * - * Get FPGA Manager from "fpga-mgr" property or from ancestor region. - * - * Caller should call fpga_mgr_put() when done with manager. - * - * Return: fpga manager struct or IS_ERR() condition containing error code. - */ -static struct fpga_manager *fpga_region_get_manager(struct fpga_region *region) -{ - struct device *dev = ®ion->dev; - struct device_node *np = dev->of_node; - struct device_node *mgr_node; - struct fpga_manager *mgr; - - of_node_get(np); - while (np) { - if (of_device_is_compatible(np, "fpga-region")) { - mgr_node = of_parse_phandle(np, "fpga-mgr", 0); - if (mgr_node) { - mgr = of_fpga_mgr_get(mgr_node); - of_node_put(np); - return mgr; - } - } - np = of_get_next_parent(np); - } - of_node_put(np); - - return ERR_PTR(-EINVAL); -} - -/** - * fpga_region_get_bridges - create a list of bridges - * @region: FPGA region - * @reg_ovl: overlay applied to the region - * - * Create a list of bridges including the parent bridge and the bridges - * specified by "fpga-bridges" property. Note that the - * fpga_bridges_enable/disable/put functions are all fine with an empty list - * if that happens. - * - * Caller should call fpga_bridges_put(®ion->bridge_list) when - * done with the bridges. - * - * Return 0 for success (even if there are no bridges specified) - * or -EBUSY if any of the bridges are in use. - */ -static int fpga_region_get_bridges(struct fpga_region *region, - struct region_overlay *reg_ovl) -{ - struct device *dev = ®ion->dev; - struct device_node *region_np = dev->of_node; - struct device_node *br, *np, *parent_br = NULL; - int i, ret; - - /* If parent is a bridge, add to list */ - ret = of_fpga_bridge_get_to_list(region_np->parent, - reg_ovl->image_info, - ®ion->bridge_list); - if (ret == -EBUSY) - return ret; - - if (!ret) - parent_br = region_np->parent; - - /* If overlay has a list of bridges, use it. */ - if (of_parse_phandle(reg_ovl->overlay, "fpga-bridges", 0)) - np = reg_ovl->overlay; - else - np = region_np; - - for (i = 0; ; i++) { - br = of_parse_phandle(np, "fpga-bridges", i); - if (!br) - break; - - /* If parent bridge is in list, skip it. */ - if (br == parent_br) - continue; - - /* If node is a bridge, get it and add to list */ - ret = of_fpga_bridge_get_to_list(br, reg_ovl->image_info, - ®ion->bridge_list); - - /* If any of the bridges are in use, give up */ - if (ret == -EBUSY) { - fpga_bridges_put(®ion->bridge_list); - return -EBUSY; - } - } - - return 0; -} - -/** * fpga_region_program_fpga - program FPGA * @region: FPGA region that is receiving an overlay * @reg_ovl: region overlay with fpga_image_info parsed from overlay @@ -247,10 +161,9 @@ static int fpga_region_get_bridges(struct fpga_region *region, * * Return: 0 for success or negative error code. */ -static int fpga_region_program_fpga(struct fpga_region *region, - struct region_overlay *reg_ovl) +int fpga_region_program_fpga(struct fpga_region *region, + struct fpga_image_info *image_info) { - struct fpga_manager *mgr; int ret; region = fpga_region_get(region); @@ -259,22 +172,22 @@ static int fpga_region_program_fpga(struct fpga_region *region, return PTR_ERR(region); } - mgr = fpga_region_get_manager(region); - if (IS_ERR(mgr)) { - pr_err("failed to get fpga region manager\n"); - return PTR_ERR(mgr); - } - - ret = fpga_mgr_lock(mgr); - if (ret) { - pr_err("FPGA manager is busy\n"); - goto err_put_mgr; + ret = fpga_mgr_lock(region->mgr); + if (ret < 0) { + pr_err("fpga manager is busy\n"); + goto err_put_region; } - ret = fpga_region_get_bridges(region, reg_ovl); - if (ret) { - pr_err("failed to get fpga region bridges\n"); - goto err_unlock_mgr; + /* + * In some cases, we already have a list of bridges in the + * fpga region struct. Or we don't have any bridges. + */ + if (region->get_bridges) { + ret = region->get_bridges(region, image_info); + if (ret) { + pr_err("failed to get fpga region bridges\n"); + goto err_unlock_mgr; + } } ret = fpga_bridges_disable(®ion->bridge_list); @@ -283,7 +196,7 @@ static int fpga_region_program_fpga(struct fpga_region *region, goto err_put_br; } - ret = fpga_mgr_load(mgr, reg_ovl->image_info); + ret = fpga_mgr_load(region->mgr, image_info); if (ret) { pr_err("failed to load fpga image\n"); goto err_put_br; @@ -295,309 +208,39 @@ static int fpga_region_program_fpga(struct fpga_region *region, goto err_put_br; } - fpga_mgr_unlock(mgr); - fpga_mgr_put(mgr); + region->image_info = image_info; + + fpga_mgr_unlock(region->mgr); fpga_region_put(region); return 0; err_put_br: - fpga_bridges_put(®ion->bridge_list); + if (region->get_bridges) + fpga_bridges_put(®ion->bridge_list); err_unlock_mgr: - fpga_mgr_unlock(mgr); -err_put_mgr: - fpga_mgr_put(mgr); + fpga_mgr_unlock(region->mgr); +err_put_region: fpga_region_put(region); return ret; } +EXPORT_SYMBOL_GPL(fpga_region_program_fpga); -/** - * child_regions_with_firmware - * @overlay: device node of the overlay - * - * If the overlay adds child FPGA regions, they are not allowed to have - * firmware-name property. - * - * Return 0 for OK or -EINVAL if child FPGA region adds firmware-name. - */ -static int child_regions_with_firmware(struct device_node *overlay) +int fpga_region_register(struct device *dev, struct fpga_region *region) { - struct device_node *child_region; - const char *child_firmware_name; - int ret = 0; - - of_node_get(overlay); - - child_region = of_find_matching_node(overlay, fpga_region_of_match); - while (child_region) { - if (!of_property_read_string(child_region, "firmware-name", - &child_firmware_name)) { - ret = -EINVAL; - break; - } - child_region = of_find_matching_node(child_region, - fpga_region_of_match); - } - - of_node_put(child_region); - - if (ret) - pr_err("firmware-name not allowed in child FPGA region: %s", - child_region->full_name); - - return ret; -} - -/** - * fpga_region_parse_ov - parse and check overlay applied to region - * - * @region: FPGA region - * @overlay: overlay applied to the FPGA region - * - * Given an overlay applied to a FPGA region, parse the FPGA image specific - * info in the overlay and do some checking. - * - * Returns: - * NULL if overlay doesn't direct us to program the FPGA. - * fpga_image_info struct if there is an image to program. - * error code for invalid overlay. - */ -static struct fpga_image_info *fpga_region_parse_ov(struct fpga_region *region, - struct device_node *overlay) -{ - struct device *dev = ®ion->dev; - struct fpga_image_info *info; - int ret; - - /* - * Reject overlay if child FPGA Regions added in the overlay have - * firmware-name property (would mean that an FPGA region that has - * not been added to the live tree yet is doing FPGA programming). - */ - ret = child_regions_with_firmware(overlay); - if (ret) - return ERR_PTR(ret); - - info = devm_kzalloc(dev, sizeof(*info), GFP_KERNEL); - if (!info) - return ERR_PTR(-ENOMEM); - - if (of_property_read_bool(overlay, "partial-fpga-config")) - info->flags |= FPGA_MGR_PARTIAL_RECONFIG; - - if (of_property_read_bool(overlay, "external-fpga-config")) - info->flags |= FPGA_MGR_EXTERNAL_CONFIG; - - of_property_read_string(overlay, "firmware-name", &info->firmware_name); - - of_property_read_u32(overlay, "region-unfreeze-timeout-us", - &info->enable_timeout_us); - - of_property_read_u32(overlay, "region-freeze-timeout-us", - &info->disable_timeout_us); - - /* If overlay is not programming the FPGA, don't need FPGA image info */ - if (!info->firmware_name) { - devm_kfree(dev, info); - return NULL; - } - - /* - * If overlay informs us FPGA was externally programmed, specifying - * firmware here would be ambiguous. - */ - if (info->flags & FPGA_MGR_EXTERNAL_CONFIG) { - dev_err(dev, "error: specified firmware and external-fpga-config"); - devm_kfree(dev, info); - return ERR_PTR(-EINVAL); - } - - /* - * The first overlay to a region may reprogram the FPGA and specify how - * to program the fpga (fpga_image_info). Subsequent overlays can be - * can add/modify child node properties if that is useful. - */ - if (!list_empty(®ion->overlays)) { - dev_err(dev, "Only 1st DTO to a region may program a FPGA.\n"); - devm_kfree(dev, info); - return ERR_PTR(-EINVAL); - } - - return info; -} - -/** - * fpga_region_notify_pre_apply - pre-apply overlay notification - * - * @region: FPGA region that the overlay will be applied to - * @nd: overlay notification data - * - * Called when an overlay targeted to a FPGA Region is about to be applied. - * Parses the overlay for properties that influence how the FPGA will be - * programmed and does some checking. If the checks pass, programs the FPGA. - * - * If the overlay that breaks the rules, notifier returns an error and the - * overlay is rejected, preventing it from being added to the main tree. - * - * Return: 0 for success or negative error code for failure. - */ -static int fpga_region_notify_pre_apply(struct fpga_region *region, - struct of_overlay_notify_data *nd) -{ - struct device *dev = ®ion->dev; - struct region_overlay *reg_ovl; - struct fpga_image_info *info; - unsigned long flags; - int ret; - - info = fpga_region_parse_ov(region, nd->overlay); - if (IS_ERR(info)) - return PTR_ERR(info); - - reg_ovl = devm_kzalloc(dev, sizeof(*reg_ovl), GFP_KERNEL); - if (!reg_ovl) - return -ENOMEM; - - reg_ovl->overlay = nd->overlay; - reg_ovl->image_info = info; - - if (info) { - ret = fpga_region_program_fpga(region, reg_ovl); - if (ret) - goto pre_a_err; - } - - spin_lock_irqsave(&overlay_list_lock, flags); - list_add_tail(®_ovl->node, ®ion->overlays); - spin_unlock_irqrestore(&overlay_list_lock, flags); - - return 0; - -pre_a_err: - if (info) - devm_kfree(dev, info); - devm_kfree(dev, reg_ovl); - return ret; -} - -/** - * fpga_region_notify_post_remove - post-remove overlay notification - * - * @region: FPGA region that was targeted by the overlay that was removed - * @nd: overlay notification data - * - * Called after an overlay has been removed if the overlay's target was a - * FPGA region. - */ -static void fpga_region_notify_post_remove(struct fpga_region *region, - struct of_overlay_notify_data *nd) -{ - struct region_overlay *reg_ovl; - unsigned long flags; - - reg_ovl = list_last_entry(®ion->overlays, typeof(*reg_ovl), node); - - fpga_bridges_disable(®ion->bridge_list); - fpga_bridges_put(®ion->bridge_list); - - spin_lock_irqsave(&overlay_list_lock, flags); - list_del(®_ovl->node); - spin_unlock_irqrestore(&overlay_list_lock, flags); - - if (reg_ovl->image_info) - devm_kfree(®ion->dev, reg_ovl->image_info); - - devm_kfree(®ion->dev, reg_ovl); -} - -/** - * of_fpga_region_notify - reconfig notifier for dynamic DT changes - * @nb: notifier block - * @action: notifier action - * @arg: reconfig data - * - * This notifier handles programming a FPGA when a "firmware-name" property is - * added to a fpga-region. - * - * Returns NOTIFY_OK or error if FPGA programming fails. - */ -static int of_fpga_region_notify(struct notifier_block *nb, - unsigned long action, void *arg) -{ - struct of_overlay_notify_data *nd = arg; - struct fpga_region *region; - int ret; - - switch (action) { - case OF_OVERLAY_PRE_APPLY: - pr_debug("%s OF_OVERLAY_PRE_APPLY\n", __func__); - break; - case OF_OVERLAY_POST_APPLY: - pr_debug("%s OF_OVERLAY_POST_APPLY\n", __func__); - return NOTIFY_OK; /* not for us */ - case OF_OVERLAY_PRE_REMOVE: - pr_debug("%s OF_OVERLAY_PRE_REMOVE\n", __func__); - return NOTIFY_OK; /* not for us */ - case OF_OVERLAY_POST_REMOVE: - pr_debug("%s OF_OVERLAY_POST_REMOVE\n", __func__); - break; - default: /* should not happen */ - return NOTIFY_OK; - } - - region = fpga_region_find(nd->target); - if (!region) - return NOTIFY_OK; - - ret = 0; - switch (action) { - case OF_OVERLAY_PRE_APPLY: - ret = fpga_region_notify_pre_apply(region, nd); - break; - - case OF_OVERLAY_POST_REMOVE: - fpga_region_notify_post_remove(region, nd); - break; - } - - put_device(®ion->dev); - - if (ret) - return notifier_from_errno(ret); - - return NOTIFY_OK; -} - -static struct notifier_block fpga_region_of_nb = { - .notifier_call = of_fpga_region_notify, -}; - -static int fpga_region_probe(struct platform_device *pdev) -{ - struct device *dev = &pdev->dev; - struct device_node *np = dev->of_node; - struct fpga_region *region; int id, ret = 0; - region = kzalloc(sizeof(*region), GFP_KERNEL); - if (!region) - return -ENOMEM; - id = ida_simple_get(&fpga_region_ida, 0, 0, GFP_KERNEL); - if (id < 0) { - ret = id; - goto err_kfree; - } + if (id < 0) + return id; mutex_init(®ion->mutex); INIT_LIST_HEAD(®ion->bridge_list); - INIT_LIST_HEAD(®ion->overlays); - device_initialize(®ion->dev); region->dev.class = fpga_region_class; region->dev.parent = dev; - region->dev.of_node = np; + region->dev.of_node = dev->of_node; region->dev.id = id; dev_set_drvdata(dev, region); @@ -609,82 +252,49 @@ static int fpga_region_probe(struct platform_device *pdev) if (ret) goto err_remove; - of_platform_populate(np, fpga_region_of_match, NULL, ®ion->dev); - dev_info(dev, "FPGA Region probed\n"); return 0; err_remove: ida_simple_remove(&fpga_region_ida, id); -err_kfree: - kfree(region); return ret; } +EXPORT_SYMBOL_GPL(fpga_region_register); -static int fpga_region_remove(struct platform_device *pdev) +int fpga_region_unregister(struct fpga_region *region) { - struct fpga_region *region = platform_get_drvdata(pdev); - device_unregister(®ion->dev); return 0; } - -static struct platform_driver fpga_region_driver = { - .probe = fpga_region_probe, - .remove = fpga_region_remove, - .driver = { - .name = "fpga-region", - .of_match_table = of_match_ptr(fpga_region_of_match), - }, -}; +EXPORT_SYMBOL_GPL(fpga_region_unregister); static void fpga_region_dev_release(struct device *dev) { struct fpga_region *region = to_fpga_region(dev); ida_simple_remove(&fpga_region_ida, region->dev.id); - kfree(region); } /** * fpga_region_init - init function for fpga_region class - * Creates the fpga_region class and registers a reconfig notifier. + * Creates the fpga_region class. */ static int __init fpga_region_init(void) { - int ret; - fpga_region_class = class_create(THIS_MODULE, "fpga_region"); if (IS_ERR(fpga_region_class)) return PTR_ERR(fpga_region_class); fpga_region_class->dev_release = fpga_region_dev_release; - ret = of_overlay_notifier_register(&fpga_region_of_nb); - if (ret) - goto err_class; - - ret = platform_driver_register(&fpga_region_driver); - if (ret) - goto err_plat; - return 0; - -err_plat: - of_overlay_notifier_unregister(&fpga_region_of_nb); -err_class: - class_destroy(fpga_region_class); - ida_destroy(&fpga_region_ida); - return ret; } static void __exit fpga_region_exit(void) { - platform_driver_unregister(&fpga_region_driver); - of_overlay_notifier_unregister(&fpga_region_of_nb); class_destroy(fpga_region_class); ida_destroy(&fpga_region_ida); } diff --git a/drivers/fpga/fpga-region.h b/drivers/fpga/fpga-region.h new file mode 100644 index 0000000..e041015 --- /dev/null +++ b/drivers/fpga/fpga-region.h @@ -0,0 +1,68 @@ +#include +#include +#include + +#ifndef _FPGA_REGION_H +#define _FPGA_REGION_H + +/** + * struct fpga_region - FPGA Region structure + * @dev: FPGA Region device + * @mutex: enforces exclusive reference to region + * @bridge_list: list of FPGA bridges specified in region + * @overlays: list of struct region_overlay_info + * @mgr_dev: device of fpga manager + * @priv: private data + */ +struct fpga_region { + struct device dev; + struct mutex mutex; /* for exclusive reference to region */ + struct list_head bridge_list; + struct fpga_manager *mgr; + struct fpga_image_info *image_info; + void *priv; + int (*get_bridges)(struct fpga_region *region, + struct fpga_image_info *image_info); +#if IS_ENABLED(CONFIG_OF_FPGA_REGION) + struct list_head overlays; +#endif +}; + +#if IS_ENABLED(CONFIG_OF_FPGA_REGION) +/** + * struct region_overlay: info regarding overlays applied to the region + * @node: list node + * @overlay: pointer to overlay + * @image_info: fpga image specific information parsed from overlay. Is NULL if + * overlay doesn't program FPGA. + */ +struct region_overlay { + struct list_head node; + struct device_node *overlay; + struct fpga_image_info *image_info; +}; +#endif /* CONFIG_OF_FPGA_REGION */ + +#define to_fpga_region(d) container_of(d, struct fpga_region, dev) + +#ifdef CONFIG_OF +struct fpga_region *of_fpga_region_find(struct device_node *np); +#else +struct fpga_region *of_fpga_region_find(struct device_node *np) +{ + return NULL; +} +#endif /* CONFIG_OF */ + +struct fpga_image_info *fpga_region_alloc_image_info( + struct fpga_region *region); +void fpga_region_free_image_info(struct fpga_region *region, + struct fpga_image_info *image_info); + +int fpga_region_program_fpga(struct fpga_region *region, + struct fpga_image_info *image_info); + +int fpga_region_register(struct device *dev, struct fpga_region *region); +int fpga_region_unregister(struct fpga_region *region); + +#endif /* _FPGA_REGION_H */ diff --git a/drivers/fpga/of-fpga-region.c b/drivers/fpga/of-fpga-region.c new file mode 100644 index 0000000..af9de1e --- /dev/null +++ b/drivers/fpga/of-fpga-region.c @@ -0,0 +1,510 @@ +/* + * FPGA Region - Device Tree support for FPGA programming under Linux + * + * Copyright (C) 2013-2016 Altera Corporation + * + * This program is free software; you can redistribute it and/or modify it + * under the terms and conditions of the GNU General Public License, + * version 2, as published by the Free Software Foundation. + * + * This program is distributed in the hope it will be useful, but WITHOUT + * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or + * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for + * more details. + * + * You should have received a copy of the GNU General Public License along with + * this program. If not, see . + */ + +#include +#include +#include +#include +#include +#include +#include +#include +#include +#include "fpga-region.h" + +/* Lock for list of overlays */ +spinlock_t overlay_list_lock; + +/** + * of_fpga_region_get_manager - get pointer for FPGA Manager + * @dev: FPGA region's device + * + * Get FPGA Manager from "fpga-mgr" property in region or in ancestor region. + * + * Caller should call fpga_mgr_put() when done with manager. + * + * Return: fpga manager struct or IS_ERR() condition containing error code. + */ +static struct fpga_manager *of_fpga_region_get_mgr(struct device_node *np) +{ + struct device_node *mgr_node; + struct fpga_manager *mgr; + + of_node_get(np); + while (np) { + if (of_device_is_compatible(np, "fpga-region")) { + mgr_node = of_parse_phandle(np, "fpga-mgr", 0); + if (mgr_node) { + mgr = of_fpga_mgr_get(mgr_node); + of_node_put(np); + return mgr; + } + } + np = of_get_next_parent(np); + } + of_node_put(np); + + return ERR_PTR(-EINVAL); +} + +/** + * of_fpga_region_get_bridges - create a list of bridges + * @region: FPGA region + * @image_info: FPGA image info + * + * Create a list of bridges including the parent bridge and the bridges + * specified by "fpga-bridges" property. Note that the + * fpga_bridges_enable/disable/put functions are all fine with an empty list + * if that happens. + * + * Caller should call fpga_bridges_put(®ion->bridge_list) when + * done with the bridges. + * + * Return 0 for success (even if there are no bridges specified) + * or -EBUSY if any of the bridges are in use. + */ +static int of_fpga_region_get_bridges(struct fpga_region *region, + struct fpga_image_info *image_info) +{ + struct device *dev = ®ion->dev; + struct device_node *region_np = dev->of_node; + struct device_node *br, *np, *parent_br = NULL; + int i, ret; + + /* If parent is a bridge, add to list */ + ret = of_fpga_bridge_get_to_list(region_np->parent, + image_info, + ®ion->bridge_list); + if (ret == -EBUSY) + return ret; + + if (!ret) + parent_br = region_np->parent; + + /* If overlay has a list of bridges, use it. */ + if (of_parse_phandle(image_info->overlay, "fpga-bridges", 0)) + np = image_info->overlay; + else + np = region_np; + + for (i = 0; ; i++) { + br = of_parse_phandle(np, "fpga-bridges", i); + if (!br) + break; + + /* If parent bridge is in list, skip it. */ + if (br == parent_br) + continue; + + /* If node is a bridge, get it and add to list */ + ret = of_fpga_bridge_get_to_list(br, image_info, + ®ion->bridge_list); + + /* If any of the bridges are in use, give up */ + if (ret == -EBUSY) { + fpga_bridges_put(®ion->bridge_list); + return -EBUSY; + } + } + + return 0; +} + +static const struct of_device_id fpga_region_of_match[] = { + { .compatible = "fpga-region", }, + {}, +}; +MODULE_DEVICE_TABLE(of, fpga_region_of_match); + +/** + * child_regions_with_firmware + * @overlay: device node of the overlay + * + * If the overlay adds child FPGA regions, they are not allowed to have + * firmware-name property. + * + * Return 0 for OK or -EINVAL if child FPGA region adds firmware-name. + */ +static int child_regions_with_firmware(struct device_node *overlay) +{ + struct device_node *child_region; + const char *child_firmware_name; + int ret = 0; + + of_node_get(overlay); + + child_region = of_find_matching_node(overlay, fpga_region_of_match); + while (child_region) { + if (!of_property_read_string(child_region, "firmware-name", + &child_firmware_name)) { + ret = -EINVAL; + break; + } + child_region = of_find_matching_node(child_region, + fpga_region_of_match); + } + + of_node_put(child_region); + + if (ret) + pr_err("firmware-name not allowed in child FPGA region: %s", + child_region->full_name); + + return ret; +} + +/** + * of_fpga_region_parse_ov - parse and check overlay applied to region + * + * @region: FPGA region + * @overlay: overlay applied to the FPGA region + * + * Given an overlay applied to a FPGA region, parse the FPGA image specific + * info in the overlay and do some checking. + * + * Returns: + * NULL if overlay doesn't direct us to program the FPGA. + * fpga_image_info struct if there is an image to program. + * error code for invalid overlay. + */ +static struct fpga_image_info *of_fpga_region_parse_ov( + struct fpga_region *region, + struct device_node *overlay) +{ + struct device *dev = ®ion->dev; + struct fpga_image_info *info; + const char *firmware_name; + int ret; + + /* + * Reject overlay if child FPGA Regions added in the overlay have + * firmware-name property (would mean that an FPGA region that has + * not been added to the live tree yet is doing FPGA programming). + */ + ret = child_regions_with_firmware(overlay); + if (ret) + return ERR_PTR(ret); + + info = fpga_region_alloc_image_info(region); + if (!info) + return ERR_PTR(-ENOMEM); + + info->overlay = overlay; + + if (of_property_read_bool(overlay, "partial-fpga-config")) + info->flags |= FPGA_MGR_PARTIAL_RECONFIG; + + if (of_property_read_bool(overlay, "external-fpga-config")) + info->flags |= FPGA_MGR_EXTERNAL_CONFIG; + + if (!of_property_read_string(overlay, "firmware-name", + &firmware_name)) { + info->firmware_name = devm_kzalloc(dev, + strlen(firmware_name), + GFP_KERNEL); + if (!info->firmware_name) + return ERR_PTR(-ENOMEM); + + strcpy(info->firmware_name, firmware_name); + } + + of_property_read_u32(overlay, "region-unfreeze-timeout-us", + &info->enable_timeout_us); + + of_property_read_u32(overlay, "region-freeze-timeout-us", + &info->disable_timeout_us); + + /* If overlay is not programming the FPGA, don't need FPGA image info */ + if (!info->firmware_name) { + ret = 0; + goto ret_no_info; + } + + /* + * If overlay informs us FPGA was externally programmed, specifying + * firmware here would be ambiguous. + */ + if (info->flags & FPGA_MGR_EXTERNAL_CONFIG) { + dev_err(dev, "error: specified firmware and external-fpga-config"); + ret = -EINVAL; + goto ret_no_info; + } + + /* + * The first overlay to a region may reprogram the FPGA and specify how + * to program the fpga (fpga_image_info). Subsequent overlays can be + * can add/modify child node properties if that is useful. + */ + if (!list_empty(®ion->overlays)) { + dev_err(dev, "Only 1st DTO to a region may program a FPGA.\n"); + ret = -EINVAL; + goto ret_no_info; + } + + return info; +ret_no_info: + fpga_region_free_image_info(region, info); + return ERR_PTR(ret); +} + +static int of_fpga_region_list_add_ovl(struct fpga_region *region, + struct device_node *overlay, + struct fpga_image_info *info) +{ + unsigned long flags; + struct region_overlay *reg_ovl; + + reg_ovl = devm_kzalloc(®ion->dev, sizeof(*reg_ovl), GFP_KERNEL); + if (!reg_ovl) + return -ENOMEM; + + reg_ovl->overlay = overlay; + reg_ovl->image_info = info; + + spin_lock_irqsave(&overlay_list_lock, flags); + list_add_tail(®_ovl->node, ®ion->overlays); + spin_unlock_irqrestore(&overlay_list_lock, flags); + + return 0; +} + +static void of_fpga_region_list_rm_ovl(struct fpga_region *region, + struct region_overlay *reg_ovl) +{ + unsigned long flags; + + spin_lock_irqsave(&overlay_list_lock, flags); + list_del(®_ovl->node); + spin_unlock_irqrestore(&overlay_list_lock, flags); + + fpga_region_free_image_info(region, reg_ovl->image_info); + devm_kfree(®ion->dev, reg_ovl); +} + +/** + * of_fpga_region_notify_pre_apply - pre-apply overlay notification + * + * @region: FPGA region that the overlay will be applied to + * @nd: overlay notification data + * + * Called when an overlay targeted to a FPGA Region is about to be applied. + * Parses the overlay for properties that influence how the FPGA will be + * programmed and does some checking. If the checks pass, programs the FPGA. + * + * If the overlay that breaks the rules, notifier returns an error and the + * overlay is rejected, preventing it from being added to the main tree. + * + * Return: 0 for success or negative error code for failure. + */ +static int of_fpga_region_notify_pre_apply(struct fpga_region *region, + struct of_overlay_notify_data *nd) +{ + struct fpga_image_info *info; + int ret; + + info = of_fpga_region_parse_ov(region, nd->overlay); + if (IS_ERR(info)) + return PTR_ERR(info); + + if (info) { + ret = fpga_region_program_fpga(region, info); + if (ret) + goto pre_a_err; + } + + ret = of_fpga_region_list_add_ovl(region, nd->overlay, info); + if (ret) + goto pre_a_err; + + return 0; + +pre_a_err: + fpga_region_free_image_info(region, info); + return ret; +} + +/** + * of_fpga_region_notify_post_remove - post-remove overlay notification + * + * @region: FPGA region that was targeted by the overlay that was removed + * @nd: overlay notification data + * + * Called after an overlay has been removed if the overlay's target was a + * FPGA region. + */ +static void of_fpga_region_notify_post_remove(struct fpga_region *region, + struct of_overlay_notify_data *nd) +{ + struct region_overlay *reg_ovl; + + reg_ovl = list_last_entry(®ion->overlays, typeof(*reg_ovl), node); + + fpga_bridges_disable(®ion->bridge_list); + fpga_bridges_put(®ion->bridge_list); + + if (reg_ovl) + of_fpga_region_list_rm_ovl(region, reg_ovl); +} + +/** + * of_fpga_region_notify - reconfig notifier for dynamic DT changes + * @nb: notifier block + * @action: notifier action + * @arg: reconfig data + * + * This notifier handles programming a FPGA when a "firmware-name" property is + * added to a fpga-region. + * + * Returns NOTIFY_OK or error if FPGA programming fails. + */ +static int of_fpga_region_notify(struct notifier_block *nb, + unsigned long action, void *arg) +{ + struct of_overlay_notify_data *nd = arg; + struct fpga_region *region; + int ret; + + switch (action) { + case OF_OVERLAY_PRE_APPLY: + pr_debug("%s OF_OVERLAY_PRE_APPLY\n", __func__); + break; + case OF_OVERLAY_POST_APPLY: + pr_debug("%s OF_OVERLAY_POST_APPLY\n", __func__); + return NOTIFY_OK; /* not for us */ + case OF_OVERLAY_PRE_REMOVE: + pr_debug("%s OF_OVERLAY_PRE_REMOVE\n", __func__); + return NOTIFY_OK; /* not for us */ + case OF_OVERLAY_POST_REMOVE: + pr_debug("%s OF_OVERLAY_POST_REMOVE\n", __func__); + break; + default: /* should not happen */ + return NOTIFY_OK; + } + + region = of_fpga_region_find(nd->target); + if (!region) + return NOTIFY_OK; + + ret = 0; + switch (action) { + case OF_OVERLAY_PRE_APPLY: + ret = of_fpga_region_notify_pre_apply(region, nd); + break; + + case OF_OVERLAY_POST_REMOVE: + of_fpga_region_notify_post_remove(region, nd); + break; + } + + put_device(®ion->dev); + + if (ret) + return notifier_from_errno(ret); + + return NOTIFY_OK; +} + +static struct notifier_block fpga_region_of_nb = { + .notifier_call = of_fpga_region_notify, +}; + +static int of_fpga_region_probe(struct platform_device *pdev) +{ + struct device *dev = &pdev->dev; + struct device_node *np = dev->of_node; + struct fpga_manager *mgr; + struct fpga_region *region; + int ret; + + region = devm_kzalloc(dev, sizeof(*region), GFP_KERNEL); + if (!region) + return -ENOMEM; + + INIT_LIST_HEAD(®ion->overlays); + + /* Find the FPGA mgr specified by region or parent region. */ + mgr = of_fpga_region_get_mgr(np); + if (IS_ERR(mgr)) { + ret = PTR_ERR(mgr); + goto err_kfree; + } + region->mgr = mgr; + + /* Specify how to get bridges for this type of region. */ + region->get_bridges = of_fpga_region_get_bridges; + + ret = fpga_region_register(dev, region); + if (ret) + goto err_put_mgr; + + of_platform_populate(np, fpga_region_of_match, NULL, ®ion->dev); + dev_info(dev, "FPGA Region probed\n"); + + return ret; + +err_put_mgr: + fpga_mgr_put(mgr); +err_kfree: + devm_kfree(dev, region); + + return ret; +} + +static int of_fpga_region_remove(struct platform_device *pdev) +{ + struct device *dev = &pdev->dev; + struct fpga_region *region = platform_get_drvdata(pdev); + + fpga_region_unregister(region); + devm_kfree(dev, region); + + return 0; +} + +static struct platform_driver fpga_region_driver = { + .probe = of_fpga_region_probe, + .remove = of_fpga_region_remove, + .driver = { + .name = "fpga-region", + .of_match_table = of_match_ptr(fpga_region_of_match), + }, +}; + +static int __init of_fpga_region_notifier_init(void) +{ + int ret; + + ret = platform_driver_register(&fpga_region_driver); + if (ret) + return ret; + + return of_overlay_notifier_register(&fpga_region_of_nb); +} + +static void __exit of_fpga_region_notifier_exit(void) +{ + of_overlay_notifier_unregister(&fpga_region_of_nb); + platform_driver_unregister(&fpga_region_driver); +} + +device_initcall(of_fpga_region_notifier_init); +module_exit(of_fpga_region_notifier_exit); + +MODULE_DESCRIPTION("OF FPGA Region"); +MODULE_AUTHOR("Alan Tull "); +MODULE_LICENSE("GPL v2"); diff --git a/include/linux/fpga/fpga-mgr.h b/include/linux/fpga/fpga-mgr.h index ae970ca..0f5072c 100644 --- a/include/linux/fpga/fpga-mgr.h +++ b/include/linux/fpga/fpga-mgr.h @@ -80,15 +80,19 @@ enum fpga_mgr_states { * @sgt: scatter/gather table containing FPGA image * @buf: contiguous buffer containing FPGA image * @count: size of buf + * @overlay: Device Tree overlay */ struct fpga_image_info { u32 flags; u32 enable_timeout_us; u32 disable_timeout_us; - const char *firmware_name; + char *firmware_name; struct sg_table *sgt; const char *buf; size_t count; +#ifdef CONFIG_OF + struct device_node *overlay; +#endif }; /**