Detecting Backdoors in Neural Networks Using Novel Feature Based Anomaly Detection. This paper proposes a new defense against neural network backdooring attacks that are maliciously trained to mispredict in the presence of attacker chosen triggers. Our defense is based on the intuition that the feature extraction layers of a backdoored network embed new features to detect the presence of a trigger and the subsequent classification layers learn to mispredict when triggers are detected. Therefore, to detect backdoors, the proposed defense uses two synergistic anomaly detectors trained on clean validation data the first is a novelty detector that checks for anomalous features, while the second detects anomalous mappings from features to outputs by comparing with a separate classifier trained on validation data. The approach is evaluated on a wide range of backdoored networks (with multiple variations of triggers) that successfully evade state of the art defenses. Additionally, we evaluate the robustness of our approach on imperceptible perturbations, scalability on large scale datasets, and effectiveness under domain shift. This paper also shows that the defense can be further improved using data augmentation.


Non Linear Multiple Field Interactions Neural Document Ranking. Ranking tasks are usually based on the text of the main body of the page and the actions (clicks) of users on the page. There are other elements that could be leveraged to better contextualise the ranking experience (e.g. text in other fields, query made by the user, images, etc). We present one of the first in depth analyses of field interaction for multiple field ranking in two separate datasets. While some works have taken advantage of full document structure, some aspects remain unexplored. In this work we build on previous analyses to show how query field interactions, non linear field interactions, and the architecture of the underlying neural model affect performance.


Non target Structural Displacement Measurement Using Reference Frame Based Deepflow. Structural displacement is crucial for structural health monitoring, although it is very challenging to measure in field conditions. Most existing displacement measurement methods are costly, labor intensive, and insufficiently accurate for measuring small dynamic displacements. Computer vision (CV) based methods incorporate optical devices with advanced image processing algorithms to accurately, cost effectively, and remotely measure structural displacement with easy installation. However, non target based CV methods are still limited by insufficient feature points, incorrect feature point detection, occlusion, and drift induced by tracking error accumulation. This paper presents a reference frame based Deepflow algorithm integrated with masking and signal filtering for non target based displacement measurements. The proposed method allows the user to select points of interest for images with a low gradient for displacement tracking and directly calculate displacement without drift accumulated by measurement error. The proposed method is experimentally validated on a cantilevered beam under ambient and occluded test conditions. The accuracy of the proposed method is compared with that of a reference laser displacement sensor for validation. The significant advantage of the proposed method is its flexibility in extracting structural displacement in any region on structures that do not have distinct natural features.


Parameter robust Uzawa type iterative methods for double saddle point problems arising in Biot's consolidation and multiple network poroelasticity models. This work is concerned with the iterative solution of systems of quasi static multiple network poroelasticity (MPET) equations describing flow in elastic porous media that is permeated by single or multiple fluid networks. Here, the focus is on a three field formulation of the problem in which the displacement field of the elastic matrix and, additionally, one velocity field and one pressure field for each of the n ge 1 fluid networks are the unknown physical quantities. Generalizing Biot's model of consolidation, which is obtained for n 1 , the MPET equations for n ge1 exhibit a double saddle point structure. The proposed approach is based on a framework of augmenting and splitting this three by three block system in such a way that the resulting block Gauss Seidel preconditioner defines a fully decoupled iterative scheme for the flux , pressure , and displacement fields. In this manner, one obtains an augmented Lagrangian Uzawa type method, the analysis of which is the main contribution of this work. The parameter robust uniform linear convergence of this fixed point iteration is proved by showing that its rate of contraction is strictly less than one independent of all physical and discretization parameters. The theoretical results are confirmed by a series of numerical tests that compare the new fully decoupled scheme to the very popular partially decoupled fixed stress split iterative method, which decouples only flow the flux and pressure fields remain coupled in this case from the mechanics problem. We further test the performance of the block triangular preconditioner defining the new scheme when used to accelerate the GMRES algorithm.


Convolutional Hierarchical Attention Network for Query Focused Video Summarization. Previous approaches for video summarization mainly concentrate on finding the most diverse and representative visual contents as video summary without considering the user's preference. This paper addresses the task of query focused video summarization, which takes user's query and a long video as inputs and aims to generate a query focused video summary. In this paper, we consider the task as a problem of computing similarity between video shots and query. To this end, we propose a method, named Convolutional Hierarchical Attention Network (CHAN), which consists of two parts feature encoding network and query relevance computing module. In the encoding network, we employ a convolutional network with local self attention mechanism and query aware global attention mechanism to learns visual information of each shot. The encoded features will be sent to query relevance computing module to generate queryfocused video summary. Extensive experiments on the benchmark dataset demonstrate the competitive performance and show the effectiveness of our approach.


Performance Analysis of Reversible Binding Receptor Based Decode and Forward Relay in Molecular Communication Systems. Molecular communication (MC) allows nanomachines to communicate and cooperate with each other in a fluid environment. The diffusion based MC is popular but is easily constrained by the transmit distance due to the severe attenuation of molecule concentrations. In this letter, we present a decode and forward (DF) relay strategy for the reversible binding receptor in the diffusion based MC system. The time varying spatial distribution of the information molecules based on the reversible association and dissociation between ligand and receptor at the surface of receiver is characterized. An analytical expression for the evaluation of expected error probability is derived, and the key factors impacting on the performance are exploited. Results show that with a constant molecular budget, the proposal can improve the performance significantly, and the performance gain can be enhanced by optimizing the position of the relay node and the number of molecules assigned to the source node.


A comparison of limited memory Krylov methods for Stieltjes functions of Hermitian matrices. Given a limited amount of memory and a target accuracy, we propose and compare several polynomial Krylov methods for the approximation of f(A)b, the action of a Stieltjes matrix function of a large Hermitian matrix on a vector. Using new error bounds and estimates, as well as existing results, we derive predictions of the practical performance of the methods, and rank them accordingly. As by products, we derive new results on inexact Krylov iterations for matrix functions in order to allow for a fair comparison of rational Krylov methods with polynomial inner solves.


Interpreting the dual Riccati equation through the LQ reproducing kernel. In this study, we provide an interpretation of the dual differential Riccati equation of Linear Quadratic (LQ) optimal control problems. Adopting a novel viewpoint, we show that LQ optimal control can be seen as a regression problem over the space of controlled trajectories, and that the latter has a very natural structure as a reproducing kernel Hilbert space (RKHS). The dual Riccati equation then describes the evolution of the values of the LQ reproducing kernel when the initial time changes. This unveils new connections between control theory and kernel methods, a field widely used in machine learning.


Learning Non Markovian Reward Models in MDPs. There are situations in which an agent should receive rewards only after having accomplished a series of previous tasks. In other words, the reward that the agent receives is non Markovian. One natural and quite general way to represent history dependent rewards is via a Mealy machine a finite state automaton that produces output sequences (rewards in our case) from input sequences (state action observations in our case). In our formal setting, we consider a Markov decision process (MDP) that models the dynamic of the environment in which the agent evolves and a Mealy machine synchronised with this MDP to formalise the non Markovian reward function. While the MDP is known by the agent, the reward function is unknown from the agent and must be learnt. Learning non Markov reward functions is a challenge. Our approach to overcome this challenging problem is a careful combination of the Angluin's L active learning algorithm to learn finite automata, testing techniques for establishing conformance of finite model hypothesis and optimisation techniques for computing optimal strategies in Markovian (immediate) reward MDPs. We also show how our framework can be combined with classical heuristics such as Monte Carlo Tree Search. We illustrate our algorithms and a preliminary implementation on two typical examples for AI.


Interpolating GANs to Scaffold Autotelic Creativity. The latent space modeled by generative adversarial networks (GANs) represents a large possibility space. By interpolating categories generated by GANs, it is possible to create novel hybrid images. We present "Meet the Ganimals," a casual creator built on interpolations of BigGAN that can generate novel, hybrid animals called ganimals by efficiently searching this possibility space. Like traditional casual creators, the system supports a simple creative flow that encourages rapid exploration of the possibility space. Users can discover new ganimals, create their own, and share their reactions to aesthetic, emotional, and morphological characteristics of the ganimals. As users provide input to the system, the system adapts and changes the distribution of categories upon which ganimals are generated. As one of the first GAN based casual creators, Meet the Ganimals is an example how casual creators can leverage human curation and citizen science to discover novel artifacts within a large possibility space.


Reproducible Execution of POSIX Programs with DiOS. In this paper, we describe DiOS, a lightweight model operating system which can be used to execute programs that make use of POSIX APIs. Such executions are fully reproducible running the same program with the same inputs twice will result in two exactly identical instruction traces, even if the program uses threads for parallelism. DiOS is implemented almost entirely in portable C and C although its primary platform is DiVM, a verification oriented virtual machine, it can be configured to also run in KLEE, a symbolic executor. Finally, it can be compiled into machine code to serve as a user mode kernel. Additionally, DiOS is modular and extensible. Its various components can be combined to match both the capabilities of the underlying platform and to provide services required by a particular program. New components can be added to cover additional system calls or APIs. The experimental evaluation has two parts. DiOS is first evaluated as a component of a program verification platform based on DiVM. In the second part, we consider its portability and modularity by combining it with the symbolic executor KLEE.


Self supervised Contrastive Video Speech Representation Learning for Ultrasound. In medical imaging, manual annotations can be expensive to acquire and sometimes infeasible to access, making conventional deep learning based models difficult to scale. As a result, it would be beneficial if useful representations could be derived from raw data without the need for manual annotations. In this paper, we propose to address the problem of self supervised representation learning with multi modal ultrasound video speech raw data. For this case, we assume that there is a high correlation between the ultrasound video and the corresponding narrative speech audio of the sonographer. In order to learn meaningful representations, the model needs to identify such correlation and at the same time understand the underlying anatomical features. We designed a framework to model the correspondence between video and audio without any kind of human annotations. Within this framework, we introduce cross modal contrastive learning and an affinity aware self paced learning scheme to enhance correlation modelling. Experimental evaluations on multi modal fetal ultrasound video and audio show that the proposed approach is able to learn strong representations and transfers well to downstream tasks of standard plane detection and eye gaze prediction.


Cohomology of the Universal Abelian Surface with Applications to Arithmetic Statistics. The moduli stack mathcal A 2 of principally polarized abelian surfaces comes equipped with the universal abelian surface pi mathcal X 2 to mathcal A 2 . The fiber of pi over a point corresponding to an abelian surface A in mathcal A 2 is A itself. We determine the ell adic cohomology of mathcal X 2 as a Galois representation. Similarly, we consider the bundles mathcal X 2 n to mathcal A 2 and mathcal X 2 operatorname Sym (n) to mathcal A 2 for all n geq 1 , where the fiber over a point corresponding to an abelian surface A is A n and operatorname Sym n A respectively. We describe how to compute the ell adic cohomology of mathcal X 2 n and mathcal X 2 operatorname Sym (n) and explicitly calculate it in low degrees for all n and in all degrees for n 2 . These results yield new information regarding the arithmetic statistics on abelian surfaces, including an exact calculation of the expected value and variance as well as asymptotics for higher moments of the number of mathbf F q points.


Weak Noise Modulation Estimation of Vector Parameters. We address the problem of modulating a parameter onto a power limited signal, transmitted over a discrete time Gaussian channel and estimating this parameter at the receiver. Continuing an earlier work, where the optimal trade off between the weak noise estimation performance and the outage probability (threshold effect breakdown) was studied for a single (scalar) parameter, here we extend the derivation of the weak noise estimation performance to the case of a multi dimensional vector parameter. This turns out to be a non trivial extension, that provides a few insights and it has some interesting implications, which are discussed in depth. Several modifications and extensions of the basic setup are also studied and discussed.


Facial Expression Phoenix (FePh) An Annotated Sequenced Dataset for Facial and Emotion Specified Expressions in Sign Language. Facial expressions are important parts of both gesture and sign language recognition systems. Despite the recent advances in both fields, annotated facial expression datasets in the context of sign language are still scarce resources. In this manuscript, we introduce an annotated sequenced facial expression dataset in the context of sign language, comprising over 3000 facial images extracted from the daily news and weather forecast of the public tv station PHOENIX. Unlike the majority of currently existing facial expression datasets, FePh provides sequenced semi blurry facial images with different head poses, orientations, and movements. In addition, in the majority of images, identities are mouthing the words, which makes the data more challenging. To annotate this dataset we consider primary, secondary, and tertiary dyads of seven basic emotions of "sad", "surprise", "fear", "angry", "neutral", "disgust", and "happy". We also considered the "None" class if the image's facial expression could not be described by any of the aforementioned emotions. Although we provide FePh as a facial expression dataset of signers in sign language, it has a wider application in gesture recognition and Human Computer Interaction (HCI) systems.


Developing a Process in Architecting Microservice Infrastructure with Docker, Kubernetes, and Istio. As an application usage grows, its owner scales up vertically by replacing old machines with more powerful ones. This methodology is expensive and leads to resource waste. In response to the business needs, internet giants have developed the microservice architecture, which lets developers divide up their application into smaller units that can be hosted on multiple machines, thus enabling horizontal scale up. We propose a triphasic incremental process to transform a traditional application into a microservice application that guarantees stability during the operation. Then we demonstrated such methodology in a prototype microservice application based on an existing monolithic application. First, the developer splits a monolithic application into atomic services and aggregated services. Second, these services are packaged, containerized, and then deployed on Kubernetes. During this stage, Istio is deployed on the Kubernetes cluster to establish pod level communications, delegate traffic flows and filter requests, and enable the autoscaler. Other external add ons, such as database connections, are defined in service entry. In the last stage, we developed an algorithm guideline to minimize inter service calls by compiling all needed calls into a list and perform one finalized call. Although it increases memory usage, it avoided the wait time incurred during interservice calls. We then investigated managing configurations using config maps, recommended a pipeline being developed to perform automatic rollover.


Using Submodularity within Column Generation to Solve the Flight to Gate Assignment Problem. In this paper, we provide a column generation based approach for solving the airport flight to gate assignment problem, where the goal is to minimize the on ground portion of arrival delays by optimally assigning each scheduled flight to a compatible gate. Specifically, we use a set covering formulation for the master problem and decompose the pricing problem such that each gate is the basis for an independent pricing problem to be solved for assignment patterns with negative reduced costs. We use a combination of an approximation algorithm based on the submodularity of the underlying set and dynamic programming algorithms to solve the independent pricing problems. To the best of our knowledge, this is the first use of submodularity property to efficiently solve pricing problems and improve the performance of column generation algorithm. We show that the dynamic programming algorithm is pseudo polynomial when there are integer inputs. We also design and employ a rolling horizon method and block decomposition algorithm to solve large sized instances. Finally, we perform extensive computational experiments to validate the performance of our approach.


Effective cones of cycles on products of projective bundles over curves. Let X mathbb P (E 1) times C mathbb P (E 2) where C is a smooth curve and E 1 , E 2 are vector bundles over C .In this paper we compute the pseudo effective cones of higher codimension cycles on X .


A framework to semantify BPMN models using DEMO business transaction pattern. BPMN is a specification language widely used by industry and researchers for business process modeling and execution. It defines clearly how to articulate its concepts, but do not provide mechanism to represent the semantics of the produced models. This paper addresses the problem of how to improve the expressiveness of BPMN models, proposing a definition for the semantics of a business process within a BPMN model, and improving the completeness of the models in a systematic manner, so that models can describe far more situations with few extra managed complexity. We conceive a framework based on the business transaction patterns available in the enterprise ontology body of knowledge to prescribe the foundations of semantic BPMN models. A tool has been developed to automate the framework. Then, two industrial proof of concepts are used to measure its coverage, both positive and negative, and to argue about our proposal's usefulness. After that, the proposal is compared with others using a systematic literature review. A full BPMN pattern is proposed encompassing the happy flow, the declinations, the rejections and the revocations, without adding any new element to the BPMN specification. A software tool has been developed, and made publicly available, to support the automatic generation of the BPMN models from the proposed patterns. Our semantified BPMN pattern allowed the identification of a large amount of implicit, and other not implemented, situations in both proof of concepts. It is concluded that the usage of a semantic solution, grounded on a sound pattern, allows the systematic enrichment of the BPMN models with a bounded effort. Moreover, to simplify the BPMN executable models' implementation, its elements could be classified as implicit, explicit, or not implemented yet. Finally, related work indicates that this work is demanded, but no full solutions are available.


Asymptotic behavior for the long range nonlinear Schr "odinger equation on star graph with the Kirchhoff boundary condition. We consider the cubic nonlinear Schr " o dinger equation on the star graph with the Kirchhoff boundary condition. We prove modified scattering for the final state problem and the initial value problem. Moreover, we also consider the failure of scattering for the Schr " o dinger equation with power type long range nonlinearities. These results are extension of the results for NLS on the one dimensional Euclidean space.


Reinforcement Learning for Learning of Dynamical Systems in Uncertain Environment a Tutorial. In this paper, a review of model free reinforcement learning for learning of dynamical systems in uncertain environments has discussed. For this purpose, the Markov Decision Process (MDP) will be reviewed. Furthermore, some learning algorithms such as Temporal Difference (TD) learning, Q Learning, and Approximate Q learning as model free algorithms which constitute the main part of this article have been investigated, and benefits and drawbacks of each algorithm will be discussed. The discussed concepts in each section are explaining with details and examples.


Offline Runtime Verification of Safety Requirements using CSP. Dynamic formal verification is a key tool for providing ongoing confidence that a system is meeting its requirements while in use, especially when paired with static formal verification before the system is in use. This paper presents a workflow and Runtime Verification (RV) toolchain, Varanus, and their application to an industrial case study. Using the workflow we manually derive a Communicating Sequential Processes (CSP) model from natural language safety requirements documents, which Varanus uses as the monitor oracle. This reuse of the model means that the monitor oracle does not have to be developed separately, risking inconsistencies between it and the model for static verification. The approach is demonstrated by the offline RV of a teleoperated manipulation system, called MASCOT, which enables remote operations inside the Joint European Torus (JET) fusion reactor. We describe our model of the MASCOT safety design documents (including how the modelling process revealed an underspecification in the design) and evaluate the Varanus toolchain's utility. The workflow and tool provide validation of the safety documents, traceability of the safety properties from the documentation to the system, and a verified oracle for RV.


Time Based Roofline for Deep Learning Performance Analysis. Deep learning applications are usually very compute intensive and require a long run time for training and inference. This has been tackled by researchers from both hardware and software sides, and in this paper, we propose a Roofline based approach to performance analysis to facilitate the optimization of these applications. This approach is an extension of the Roofline model widely used in traditional high performance computing applications, and it incorporates both compute bandwidth complexity and run time in its formulae to provide insights into deep learning specific characteristics. We take two sets of representative kernels, 2D convolution and long short term memory, to validate and demonstrate the use of this new approach, and investigate how arithmetic intensity, cache locality, auto tuning, kernel launch overhead, and Tensor Core usage can affect performance. Compared to the common ad hoc approach, this study helps form a more systematic way to analyze code performance and identify optimization opportunities for deep learning applications.


Subexponential parameterized algorithms and kernelization on almost chordal graphs. We study the algorithmic properties of the graph class Chordal ke, that is, graphs that can be turned into a chordal graph by adding at most k edges or, equivalently, the class of graphs of fill in at most k. We discover that a number of fundamental intractable optimization problems being parameterized by k admit subexponential algorithms on graphs from Chordal ke. We identify a large class of optimization problems on Chordal ke that admit algorithms with the typical running time 2 O( sqrt k log k) cdot n O(1) . Examples of the problems from this class are finding an independent set of maximum weight, finding a feedback vertex set or an odd cycle transversal of minimum weight, or the problem of finding a maximum induced planar subgraph. On the other hand, we show that for some fundamental optimization problems, like finding an optimal graph coloring or finding a maximum clique, are FPT on Chordal ke when parameterized by k but do not admit subexponential in k algorithms unless ETH fails. Besides subexponential time algorithms, the class of Chordal ke graphs appears to be appealing from the perspective of kernelization (with parameter k). While it is possible to show that most of the weighted variants of optimization problems do not admit polynomial in k kernels on Chordal ke graphs, this does not exclude the existence of Turing kernelization and kernelization for unweighted graphs. In particular, we construct a polynomial Turing kernel for Weighted Clique on Chordal ke graphs. For (unweighted) Independent Set we design polynomial kernels on two interesting subclasses of Chordal ke, namely, Interval ke and Split ke graphs.


An explicit expression for Euclidean self dual cyclic codes of length 2 k over Galois ring rm GR (4,m) . For any positive integers m and k , existing literature only determines the number of all Euclidean self dual cyclic codes of length 2 k over the Galois ring rm GR (4,m) , such as in Des. Codes Cryptogr. (2012) 63 105 112 . Using properties for Kronecker products of matrices of a specific type and column vectors of these matrices, we give a simple and efficient method to construct all these self dual cyclic codes precisely. On this basis, we provide an explicit expression to accurately represent all distinct Euclidean self dual cyclic codes of length 2 k over rm GR (4,m) , using combination numbers. As an application, we list all distinct Euclidean self dual cyclic codes over rm GR (4,m) of length 2 k explicitly, for k 4,5,6 .


Common Library 1.0 A Corpus of Victorian Novels Reflecting the Population in Terms of Publication Year and Author Gender. Research in 19th century book history, sociology of literature, and quantitative literary history is blocked by the absence of a collection of novels which captures the diversity of literary production. We introduce a corpus of 75 Victorian novels sampled from a 15,322 record bibliography of novels published between 1837 and 1901 in the British Isles. This corpus, the Common Library, is distinctive in the following way the shares of novels in the corpus associated with sociologically important subgroups match the shares in the broader population. For example, the proportion of novels written by women in 1880s in the corpus is approximately the same as in the population. Although we do not, in this particular paper, claim that the corpus is a representative sample in the familiar sense a sample is representative if "characteristics of interest in the population can be estimated from the sample with a known degree of accuracy" (Lohr 2010, p. 3) we are confident that the corpus will be useful to researchers. This is because existing corpora frequently convenience samples are conspicuously misaligned with the population of published novels. They tend to over represent novels published in specific periods and novels by men. The Common Library may be used alongside or in place of these non representative convenience corpora.


Teacher Student Competition for Unsupervised Domain Adaptation. With the supervision from source domain only in class level, existing unsupervised domain adaptation (UDA) methods mainly learn the domain invariant representations from a shared feature extractor, which causes the source bias problem. This paper proposes an unsupervised domain adaptation approach with Teacher Student Competition (TSC). In particular, a student network is introduced to learn the target specific feature space, and we design a novel competition mechanism to select more credible pseudo labels for the training of student network. We introduce a teacher network with the structure of existing conventional UDA method, and both teacher and student networks compete to provide target pseudo labels to constrain every target sample's training in student network. Extensive experiments demonstrate that our proposed TSC framework significantly outperforms the state of the art domain adaptation methods on Office 31 and ImageCLEF DA benchmarks.


High symmetric n polygons. The present article includes the enumeration of n polygons with a certain symmetry property For an even number n of vertices, we count the n polygons with frac n 2 symmetry axes. In addition, if n is a power of 2, we show the relation to the perfect numbers.


Aggregation Cross Entropy for Sequence Recognition. In this paper, we propose a novel method, aggregation cross entropy (ACE), for sequence recognition from a brand new perspective. The ACE loss function exhibits competitive performance to CTC and the attention mechanism, with much quicker implementation (as it involves only four fundamental formulas), faster inference back propagation (approximately O(1) in parallel), less storage requirement (no parameter and negligible runtime memory), and convenient employment (by replacing CTC with ACE). Furthermore, the proposed ACE loss function exhibits two noteworthy properties (1) it can be directly applied for 2D prediction by flattening the 2D prediction into 1D prediction as the input and (2) it requires only characters and their numbers in the sequence annotation for supervision, which allows it to advance beyond sequence recognition, e.g., counting problem. The code is publicly available at https github.com summerlvsong Aggregation Cross Entropy.


TBar Revisiting Template based Automated Program Repair. We revisit the performance of template based APR to build comprehensive knowledge about the effectiveness of fix patterns, and to highlight the importance of complementary steps such as fault localization or donor code retrieval. To that end, we first investigate the literature to collect, summarize and label recurrently used fix patterns. Based on the investigation, we build TBar, a straightforward APR tool that systematically attempts to apply these fix patterns to program bugs. We thoroughly evaluate TBar on the Defects4J benchmark. In particular, we assess the actual qualitative and quantitative diversity of fix patterns, as well as their effectiveness in yielding plausible or correct patches. Eventually, we find that, assuming a perfect fault localization, TBar correctly plausibly fixes 74 101 bugs. Replicating a standard and practical pipeline of APR assessment, we demonstrate that TBar correctly fixes 43 bugs from Defects4J, an unprecedented performance in the literature (including all approaches, i.e., template based, stochastic mutation based or synthesis based APR).


Genetic Random Weight Change Algorithm for the Learning of Multilayer Neural Networks. A new method to improve the performance of Random weight change (RWC) algorithm based on a simple genetic algorithm, namely, Genetic random weight change (GRWC) is proposed. It is to find the optimal values of global minima via learning. In contrast to Random Weight Change (RWC), GRWC contains an effective optimization procedure which are good at exploring a large and complex space in an intellectual strategies influenced by the GA RWC synergy. By implementing our simple GA in RWC we achieve an astounding accuracy of finding global minima.


Show or Tell? Demonstration is More Robust to Changes in Shared Perception than Explanation. Successful teaching entails a complex interaction between a teacher and a learner. The teacher must select and convey information based on what they think the learner perceives and believes. Teaching always involves misaligned beliefs, but studies of pedagogy often focus on situations where teachers and learners share perceptions. Nonetheless, a teacher and learner may not always experience or attend to the same aspects of the environment. Here, we study how misaligned perceptions influence communication. We hypothesize that the efficacy of different forms of communication depends on the shared perceptual state between teacher and learner. We develop a cooperative teaching game to test whether concrete mediums (demonstrations, or "showing") are more robust than abstract ones (language, or "telling") when the teacher and learner are not perceptually aligned. We find evidence that (1) language based teaching is more affected by perceptual misalignment, but (2) demonstration based teaching is less likely to convey nuanced information. We discuss implications for human pedagogy and machine learning.


Smart technology in the classroom a systematic review.Prospects for algorithmic accountability. Artificial intelligence (AI) algorithms have emerged in the educational domain as a tool to make learning more efficient. Different applications for mastering particular skills, learning new languages, and tracking their progress are used by children. What is the impact on children from using this smart technology? We conducted a systematic review to understand the state of the art. We explored the literature in several sub disciplines wearables, child psychology, AI and education, school surveillance, and accountability. Our review identified the need for more research for each established topic. We managed to find both positive and negative effects of using wearables, but cannot conclude if smart technology use leads to lowering the young children's performance. Based on our insights we propose a framework to effectively identify accountability for smart technology in education.


Flexible Functional Split and Power Control for Energy Harvesting Cloud Radio Access Networks. Functional split is a promising technique to flexibly balance the processing cost at remote ends and the fronthaul rate in cloud radio access networks (C RAN). By harvesting renewable energy, remote radio units (RRUs) can save grid power and be flexibly deployed. However, the randomness of energy arrival poses a major design challenge. To maximize the throughput under the average fronthaul rate constraint in C RAN with renewable powered RRUs, we first study the offline problem of selecting the optimal functional split modes and the corresponding durations, jointly with the transmission power. We find that between successive energy arrivals, at most two functional split modes should be selected. Then the optimal online problem is formulated as an Markov decision process (MDP). To deal with the curse of dimensionality of solving MDP, we further analyze the special case with one instance of energy arrival and two candidate functional split modes as inspired by the offline solution, and then a heuristic online policy is proposed. Numerical results show that with flexible functional split, the throughput can be significantly improved compared with fixed functional split. Also, the proposed heuristic online policy has similar performance with the optimal online one, as validated by simulations.


Which oxidation state of uranium and thorium as point defects in xenotime is favorable?. Relativistic study of xenotime, YPO 4 , containing atoms thorium and uranium as point defects is performed in the framework of cluster model with using the compound tunable embedding potential (CTEP) method proposed by us recently. The Y (PO 4 ) 6 Y' 22 O' 104 cluster for xenotime is considered, in which central part, Y (PO 4 ) 6 15 , is the main cluster, whereas outermost 22 atoms of yttrium and 104 atoms of oxygen are treated as its environment and compose electron free CTEP with the total charge of 15 . The P and O atoms of the orthophosphate groups nearest to the central Y atom are treated at all electron level. The central Y, its substitutes, Th and U, together with environmental Y atoms are described within different versions of the generalized relativistic pseudopotential method. Correctness of our cluster and CTEP models, constructed in the paper, is justified by comparing the Y O and P O bond lengths with corresponding periodic structure values of the ypo4 crystal, both experimental and theoretical. Using this cluster model, chemical properties of solitary point defects, X U, Th, in xenotime are analyzed. It has been shown that the oxidation state 3 is energetically more profitable than 4 not only for thorium but for uranium as well ( Delta E approx 5 eV) despite the notably higher ionic radius of U 3 compared to Y 3 , whereas ionic radii of U 4 and Y 3 are close. This leads to notable local deformation of crystal geometry around the U 3 impurity in xenotime and contradicts to widespread opinion about favorite oxidation state of uranium in such kind of minerals.


Context Aware Information Lapse for Timely Status Updates in Remote Control Systems. Emerging applications in Internet of Things (IoT), such as remote monitoring and control, extensively rely on timely status updates. Age of Information (AoI) has been proposed to characterize the freshness of information in status update systems. However, it only considers the time elapsed since the generation of the latest packet, and is incapable of capturing other critical information in remote control systems, such as the stochastic evolution and the importance of the source status. In order to evaluate the timeliness of status updates in remote control systems, we propose a context aware metric, namely the context aware information lapse. The context aware information lapse characterizes both the stochastic evolution of the source status and the context aware importance of the status. In this paper, the minimization of average context aware lapse in a multi user system is considered, and a corresponding user scheduling policy is proposed based on Lyapunov optimization. Numerical results show that compared to AoI based policy, the context aware lapse based policy can achieve a substantial improvement in terms of error threshold violation probability and control performance.


Restricted online Ramsey numbers of matchings and trees. Consider a two player game between players Builder and Painter. Painter begins the game by picking a coloring of the edges of K n , which is hidden from Builder. In each round, Builder points to an edge and Painter reveals its color. Builder's goal is to locate a particular monochromatic structure in Painter's coloring by revealing the color of as few edges as possible. The fewest number of turns required for Builder to win this game is known as the restricted online Ramsey number. In this paper, we consider the situation where this "particular monochromatic structure" is a large matching or a large tree. We show that in any t coloring of E(K n) , Builder can locate a monochromatic matching on at least n t 1 over t 1 edges by revealing at most O(n log t) edges. We show also that in any 3 coloring of E(K n) , Builder can locate a monochromatic tree on at least n 2 vertices by revealing at most 5n edges.


The universal six functor formalism. We prove that Morel Voevodsky's stable mathbb A 1 homotopy theory affords the universal six functor formalism.


Decomposing predictability Semantic feature overlap between words and the dynamics of reading for meaning. The present study uses a computational approach to examine the role of semantic constraints in normal reading. This methodology avoids confounds inherent in conventional measures of predictability, allowing for theoretically deeper accounts of semantic processing. We start from a definition of associations between words based on the significant log likelihood that two words co occur frequently together in the sentences of a large text corpus. Direct associations between stimulus words were controlled, and semantic feature overlap between prime and target words was manipulated by their common associates. The stimuli consisted of sentences of the form pronoun, verb, article, adjective and noun, followed by a series of closed class words, e. g. "She rides the grey elephant on one of her many exploratory voyages". The results showed that verb noun overlap reduces single and first fixation durations of the target noun and adjective noun overlap reduces go past durations. A dynamic spreading of activation account suggests that associates of the prime words take some time to become activated The verb can act on the target noun's early eye movement measures presented three words later, while the adjective is presented immediately prior to the target, which induces sentence re examination after a difficult adjective noun semantic integration.


Describing all multivariable functional equations of dilogarithms. We prove quite general statements about functional equations in any number of variables for the dilogarithms defined by Bloch Wigner, Rogers, and Coleman, showing that they follow from certain 5 term and 2 term relations in a precise way. Unlike many other references, we use arbitrary coefficients, do not ignore any torsion, and get sharp results. For the Bloch Wigner dilogarithm, we also consider complex conjugation, and for Coleman's p adic dilogarithm we show independence of the branch.


Variational Reward Estimator Bottleneck Learning Robust Reward Estimator for Multi Domain Task Oriented Dialog. Despite its notable success in adversarial learning approaches to multi domain task oriented dialog system, training the dialog policy via adversarial inverse reinforcement learning often fails to balance the performance of the policy generator and reward estimator. During optimization, the reward estimator often overwhelms the policy generator and produces excessively uninformative gradients. We proposes the Variational Reward estimator Bottleneck (VRB), which is an effective regularization method that aims to constrain unproductive information flows between inputs and the reward estimator. The VRB focuses on capturing discriminative features, by exploiting information bottleneck on mutual information. Empirical results on a multi domain task oriented dialog dataset demonstrate that the VRB significantly outperforms previous methods.


Deep Low Shot Learning for Biological Image Classification and Visualization from Limited Training Samples. Predictive modeling is useful but very challenging in biological image analysis due to the high cost of obtaining and labeling training data. For example, in the study of gene interaction and regulation in Drosophila embryogenesis, the analysis is most biologically meaningful when in situ hybridization (ISH) gene expression pattern images from the same developmental stage are compared. However, labeling training data with precise stages is very time consuming even for evelopmental biologists. Thus, a critical challenge is how to build accurate computational models for precise developmental stage classification from limited training samples. In addition, identification and visualization of developmental landmarks are required to enable biologists to interpret prediction results and calibrate models. To address these challenges, we propose a deep two step low shot learning framework to accurately classify ISH images using limited training images. Specifically, to enable accurate model training on limited training samples, we formulate the task as a deep low shot learning problem and develop a novel two step learning approach, including data level learning and feature level learning. We use a deep residual network as our base model and achieve improved performance in the precise stage prediction task of ISH images. Furthermore, the deep model can be interpreted by computing saliency maps, which consist of pixel wise contributions of an image to its prediction result. In our task, saliency maps are used to assist the identification and visualization of developmental landmarks. Our experimental results show that the proposed model can not only make accurate predictions, but also yield biologically meaningful interpretations. We anticipate our methods to be easily generalizable to other biological image classification tasks with small training datasets.


An intrinsic characterization of cofree representations of reductive groups. We formulate and partially verify a conjecture characterizing cofree representations of connected reductive groups. As we explain, this conjecture may be viewed as a natural generalization of the Chevalley Shepard Todd theorem from the case of finite groups to the case of connected reductive groups.


Novel Backoff Mechanism for Mitigation of Congestion in DSRC Broadcast. Due to the recent re allocation of the 5.9 GHz band by the US Federal Communications Commission (FCC), it will be inevitable that dedicated short range communications (DSRC) and cellular vehicle to everything (C V2X), two representative technologies for V2X, have to address coexistence. Especially, the distributed nature of DSRC makes it not trivial to control congestions due to an asynchronous structure, which makes it inefficient to disseminate a controlling signal. To this end, we propose a method to "lighten" a distributed V2X networking. Technically, it is to allocate the backoff counter according to the level of an accident risk to which a vehicle is temporarily exposed. We provide an analysis framework based on a spatiotemporal analysis. The numerical results show the improvement in the successful delivery of basic safety messages (BSMs).


Fictitious play in zero sum stochastic games. We present a novel variant of fictitious play dynamics combining classical fictitious play with Q learning for stochastic games and analyze its convergence properties in two player zero sum stochastic games. Our dynamics involves players forming beliefs on the opponent strategy and their own continuation payoff (Q function), and playing a greedy best response by using the estimated continuation payoffs. Players update their beliefs from observations of opponent actions. A key property of the learning dynamics is that update of the beliefs on Q functions occurs at a slower timescale than update of the beliefs on strategies. We show both in the model based and model free cases (without knowledge of player payoff functions and state transition probabilities), the beliefs on strategies converge to a stationary mixed Nash equilibrium of the zero sum stochastic game.


Economy Versus Disease Spread Reopening Mechanisms for COVID 19. We study mechanisms for reopening economic activities that explore the trade off between containing the spread of COVID 19 and maximizing economic impact. This is of current importance as many organizations, cities, and states are formulating reopening strategies. Our mechanisms, referred to as group scheduling, are based on partitioning the population into groups and scheduling each group on appropriate days with possible gaps (when all are quarantined). Each group interacts with no other group and, importantly, any person who is symptomatic in a group is quarantined. Specifically, our mechanisms are characterized by three parameters (g,d,t) , where g is the number of groups, d is the number of days a group is continuously scheduled, and t is the gap between cycles. We show that our mechanisms effectively trade off economic activity for more effective control of the COVID 19 virus. In particular, we show that the (2,5,0) mechanism, which partitions the population into two groups that alternatively work for five days each, flat lines the number of COVID 19 cases quite effectively, while still maintaining economic activity at 70 of pre COVID 19 level. We also study mechanisms such as (2,3,2) and (3,3,0) that achieve a somewhat lower economic output (about 50 ) at the cost of more aggressive control of the virus these could be applicable in situations when the disease spread is more rampant in the population. We demonstrate the efficacy of our mechanisms by theoretical analysis and extensive experimental simulations on various epidemiological models. Our mechanisms prove beneficial just by regulating human interactions. Moreover, our results show that if the disease transmission (reproductive) rate is made lower by following social distancing, mask wearing, and other public health guidelines, it can further increase the efficacy of our mechanisms.


A Probabilistic Generative Model of Linguistic Typology. In the principles and parameters framework, the structural features of languages depend on parameters that may be toggled on or off, with a single parameter often dictating the status of multiple features. The implied covariance between features inspires our probabilisation of this line of linguistic inquiry we develop a generative model of language based on exponential family matrix factorisation. By modelling all languages and features within the same architecture, we show how structural similarities between languages can be exploited to predict typological features with near perfect accuracy, outperforming several baselines on the task of predicting held out features. Furthermore, we show that language embeddings pre trained on monolingual text allow for generalisation to unobserved languages. This finding has clear practical and also theoretical implications the results confirm what linguists have hypothesised, i.e. that there are significant correlations between typological features and languages.


Span Selection Pre training for Question Answering. BERT (Bidirectional Encoder Representations from Transformers) and related pre trained Transformers have provided large gains across many language understanding tasks, achieving a new state of the art (SOTA). BERT is pre trained on two auxiliary tasks Masked Language Model and Next Sentence Prediction. In this paper we introduce a new pre training task inspired by reading comprehension to better align the pre training from memorization to understanding. Span Selection Pre Training (SSPT) poses cloze like training instances, but rather than draw the answer from the model's parameters, it is selected from a relevant passage. We find significant and consistent improvements over both BERT BASE and BERT LARGE on multiple reading comprehension (MRC) datasets. Specifically, our proposed model has strong empirical evidence as it obtains SOTA results on Natural Questions, a new benchmark MRC dataset, outperforming BERT LARGE by 3 F1 points on short answer prediction. We also show significant impact in HotpotQA, improving answer prediction F1 by 4 points and supporting fact prediction F1 by 1 point and outperforming the previous best system. Moreover, we show that our pre training approach is particularly effective when training data is limited, improving the learning curve by a large amount.


TuringAdvice A Generative and Dynamic Evaluation of Language Use. We propose TuringAdvice, a new challenge task and dataset for language understanding models. Given a written situation that a real person is currently facing, a model must generate helpful advice in natural language. Our evaluation framework tests a fundamental aspect of human language understanding our ability to use language to resolve open ended situations by communicating with each other. Empirical results show that today's models struggle at TuringAdvice, even multibillion parameter models finetuned on 600k in domain training examples. The best model, a finetuned T5, writes advice that is at least as helpful as human written advice in only 14 of cases a much larger non finetunable GPT3 model does even worse at 4 . This low performance reveals language understanding errors that are hard to spot outside of a generative setting, showing much room for progress.


physics.plasm-ph physics.class-ph physics.flu-dyn physics.pop-ph

Rotational properties of annulus dusty plasma in a strong magnetic field. The collective dynamics of annulus dusty plasma formed between a co centric conducting (non conducting) disk and ring configuration is studied in a strongly magnetized radio frequency (rf) discharge. A superconducting electromagnet is used to introduce a homogeneous magnetic field to the dusty plasma medium. In absence of the magnetic field, dust grains exhibit thermal motion around their equilibrium position. The dust grains start to rotate in anticlockwise direction with increasing magnetic field (B 0.02 T), and the constant value of the angular frequency at various strengths of magnetic field confirms the rigid body rotation. The angular frequency of dust grains linearly increases up to a threshold magnetic field (B 0.6 T) and after that its value remains nearly constant in a certain range of magnetic field. Further increase in magnetic field (B 1 T) lowers the angular frequency. Low value of angular frequency is expected by reducing the width of annulus dusty plasma or the input rf power. The azimuthal ion drag force due to the magnetic field is assumed to be the energy source which drives the rotational motion. The resultant radial electric field in the presence of magnetic field determines the direction of rotation. The variation of floating (plasma) potential across the annular region at given magnetic field explains the rotational properties of the annulus dusty plasma in the presence of magnetic field.


Sup norms of newforms on GL 2 with highly ramified central character. Recently, the problem of bounding the sup norms of L 2 normalized cuspidal automorphic newforms phi on text GL 2 in the level aspect has received much attention. However at the moment strong upper bounds are only available if the central character chi of phi is not too highly ramified. In this paper, we establish a uniform upper bound in the level aspect for general chi . If the level N is a square, our result reduces to phi infty ll N frac14 epsilon , at least under the Ramanujan Conjecture. In particular, when chi has conductor N , this improves upon the previous best known bound phi infty ll N frac12 epsilon in this setup (due to Saha 14 ) and matches a lower bound due to Templier 18 , thus our result is essentially optimal in this case.


The Unreasonable Effectiveness of Transformer Language Models in Grammatical Error Correction. Recent work on Grammatical Error Correction (GEC) has highlighted the importance of language modeling in that it is certainly possible to achieve good performance by comparing the probabilities of the proposed edits. At the same time, advancements in language modeling have managed to generate linguistic output, which is almost indistinguishable from that of human generated text. In this paper, we up the ante by exploring the potential of more sophisticated language models in GEC and offer some key insights on their strengths and weaknesses. We show that, in line with recent results in other NLP tasks, Transformer architectures achieve consistently high performance and provide a competitive baseline for future machine learning models.


Improving Augmentation and Evaluation Schemes for Semantic Image Synthesis. Despite data augmentation being a de facto technique for boosting the performance of deep neural networks, little attention has been paid to developing augmentation strategies for generative adversarial networks (GANs). To this end, we introduce a novel augmentation scheme designed specifically for GAN based semantic image synthesis models. We propose to randomly warp object shapes in the semantic label maps used as an input to the generator. The local shape discrepancies between the warped and non warped label maps and images enable the GAN to learn better the structural and geometric details of the scene and thus to improve the quality of generated images. While benchmarking the augmented GAN models against their vanilla counterparts, we discover that the quantification metrics reported in the previous semantic image synthesis studies are strongly biased towards specific semantic classes as they are derived via an external pre trained segmentation network. We therefore propose to improve the established semantic image synthesis evaluation scheme by analyzing separately the performance of generated images on the biased and unbiased classes for the given segmentation network. Finally, we show strong quantitative and qualitative improvements obtained with our augmentation scheme, on both class splits, using state of the art semantic image synthesis models across three different datasets. On average across COCO Stuff, ADE20K and Cityscapes datasets, the augmented models outperform their vanilla counterparts by 3 mIoU and 10 FID points.


A "Final" Security Bug. This article discusses a fixed critical security bug in Google Tink's Ed25519 Java implementation. The bug allows remote attackers to extract the private key with only two Ed25519 signatures. The vulnerability comes from the misunderstanding of what "final" in Java programming language means. The bug was discovered during security review before Google Tink was officially released. It reinforces the challenge in writing safe cryptographic code and the importance of the security review process even for the code written by professional cryptographers.


Random cones in high dimensions I Donoho Tanner and Cover Efron cones. Two models of random cones in high dimensions are considered, together with their duals. The Donoho Tanner random cone D n,d can be defined as the positive hull of n independent d dimensional Gaussian random vectors. The Cover Efron random cone C n,d is essentially defined as the same positive hull, conditioned on the event that it is not the whole space. We consider expectations of various combinatorial and geometric functionals of these random cones and prove that they satisfy limit theorems, as d and n tend to infinity in a suitably coordinated way. This includes, for example, large deviation principles and central as well as non central limit theorems for the expected number of k faces and the k th conic intrinsic volumes, as n , d and possibly also k tend to infinity simultaneously. Furthermore, we determine the precise high dimensional asymptotic behaviour of the expected statistical dimension for both models of random cones, uncovering thereby another high dimensional phase transition. As an application, limit theorems for the number of k faces of high dimensional polytopes generated by random Gale diagrams are discussed as well.


Conjugacy classes of p elements and normal p complements. In this paper, we study the structure of finite groups with a large number of conjugacy classes of p elements for some prime p . As consequences, we obtain some new criteria for the existence of normal p complements in finite groups.


Does a central limit theorem hold for the k skeleton of Poisson hyperplanes in hyperbolic space?. Poisson processes in the space of (d 1) dimensional totally geodesic subspaces (hyperplanes) in a d dimensional hyperbolic space of constant curvature 1 are studied. The k dimensional Hausdorff measure of their k skeleton is considered. Explicit formulas for first and second order quantities restricted to bounded observation windows are obtained. The central limit problem for the k dimensional Hausdorff measure of the k skeleton is approached in two different set ups (i) for a fixed window and growing intensities, and (ii) for fixed intensity and growing spherical windows. While in case (i) the central limit theorem is valid for all d geq 2 , it is shown that in case (ii) the central limit theorem holds for d in 2,3 and fails if d geq 4 and k d 1 or if d geq 7 and for general k . Also rates of convergence are studied and multivariate central limit theorems are obtained. Moreover, the situation in which the intensity and the spherical window are growing simultaneously is discussed. In the background are the Malliavin Stein method for normal approximation and the combinatorial moment structure of Poisson U statistics as well as tools from hyperbolic integral geometry.


A BERT based Distractor Generation Scheme with Multi tasking and Negative Answer Training Strategies. In this paper, we investigate the following two limitations for the existing distractor generation (DG) methods. First, the quality of the existing DG methods are still far from practical use. There is still room for DG quality improvement. Second, the existing DG designs are mainly for single distractor generation. However, for practical MCQ preparation, multiple distractors are desired. Aiming at these goals, in this paper, we present a new distractor generation scheme with multi tasking and negative answer training strategies for effectively generating textit multiple distractors. The experimental results show that (1) our model advances the state of the art result from 28.65 to 39.81 (BLEU 1 score) and (2) the generated multiple distractors are diverse and show strong distracting power for multiple choice question.


How to Support Users in Understanding Intelligent Systems? Structuring the Discussion. The opaque nature of many intelligent systems violates established usability principles and thus presents a challenge for human computer interaction. Research in the field therefore highlights the need for transparency, scrutability, intelligibility, interpretability and explainability, among others. While all of these terms carry a vision of supporting users in understanding intelligent systems, the underlying notions and assumptions about users and their interaction with the system often remain unclear. We review the literature in HCI through the lens of implied user questions to synthesise a conceptual framework integrating user mindsets, user involvement, and knowledge outcomes to reveal, differentiate and classify current notions in prior work. This framework aims to resolve conceptual ambiguity in the field and enables researchers to clarify their assumptions and become aware of those made in prior work. We thus hope to advance and structure the dialogue in the HCI research community on supporting users in understanding intelligent systems.


Surfaces containing two parabolas through each point. We prove (under some technical assumptions) that each surface in mathbb R 3 containing two arcs of parabolas with axes parallel to Oz through each point has a parametrization left( frac P(u,v) R(u,v) , frac Q(u,v) R(u,v) , frac Z(u,v) R 2(u,v) right) for some P,Q,R,Z in mathbb R u,v such that P,Q,R have degree at most 1 in u and v , and Z has degree at most 2 in u and v . The proof is based on the observation that one can consider a parabola with vertical axis as an isotropic circle this allows us to use methods of the recent work by M. Skopenkov and R. Krasauskas in which all surfaces containing two Euclidean circles through each point are classified. Such approach also allows us to find a similar parametrization for the surfaces in mathbb R 3 containing two arbitrary isotropic circles through each point (under the same technical assumptions). Finally, we get some results concerning the top view (the projection along the Oz axis) of the surfaces in question.


AI Powered Text Generation for Harmonious Human Machine Interaction Current State and Future Directions. In the last two decades, the landscape of text generation has undergone tremendous changes and is being reshaped by the success of deep learning. New technologies for text generation ranging from template based methods to neural network based methods emerged. Meanwhile, the research objectives have also changed from generating smooth and coherent sentences to infusing personalized traits to enrich the diversification of newly generated content. With the rapid development of text generation solutions, one comprehensive survey is urgent to summarize the achievements and track the state of the arts. In this survey paper, we present the general systematical framework, illustrate the widely utilized models and summarize the classic applications of text generation.


Positive HBs antigen in the absence of hepatitis B virus infection. French recommendations for the screening of hepatitis B virus (HBV) infection were updated in 2019 with the association of three markers HBs Ag, anti HBs Ab and anti HBc Ab. These three markers allow identification of infected patients, vaccinated patients and patients who have been in contact with HBV. A positive HBs Ag is usually associated with HBV infection but this interpretation must take into account the clinical context. In particular, the absence of anti HBc Ab, normal ALAT levels and the absence of jaundice can be associated with recent HBV vaccination or false positive HBs Ag. Recent HBV vaccination can usually be confirmed by patient questioning, while confirmatory tests are useful to detect false positive HBs Ag. If necessary, a second sample can be requested to confirm the interpretation.


Towards Optimal Structured CNN Pruning via Generative Adversarial Learning. Structured pruning of filters or neurons has received increased focus for compressing convolutional neural networks. Most existing methods rely on multi stage optimizations in a layer wise manner for iteratively pruning and retraining which may not be optimal and may be computation intensive. Besides, these methods are designed for pruning a specific structure, such as filter or block structures without jointly pruning heterogeneous structures. In this paper, we propose an effective structured pruning approach that jointly prunes filters as well as other structures in an end to end manner. To accomplish this, we first introduce a soft mask to scale the output of these structures by defining a new objective function with sparsity regularization to align the output of baseline and network with this mask. We then effectively solve the optimization problem by generative adversarial learning (GAL), which learns a sparse soft mask in a label free and an end to end manner. By forcing more scaling factors in the soft mask to zero, the fast iterative shrinkage thresholding algorithm (FISTA) can be leveraged to fast and reliably remove the corresponding structures. Extensive experiments demonstrate the effectiveness of GAL on different datasets, including MNIST, CIFAR 10 and ImageNet ILSVRC 2012. For example, on ImageNet ILSVRC 2012, the pruned ResNet 50 achieves 10.88 Top 5 error and results in a factor of 3.7x speedup. This significantly outperforms state of the art methods.


Efficient high order accurate staggered semi implicit discontinuous Galerkin methods for natural convection problems. We propose a new family of high order staggered semi implicit discontinuous Galerkin (DG) methods for the simulation of natural convection problems. Assuming small temperature fluctuations, the Boussinesq approximation is valid and the flow can simply be modeled by the incompressible Navier Stokes equations coupled with a transport equation for the temperature and a buoyancy source term in the momentum equation. Our numerical scheme is developed starting from the work presented in TD14 , in which the spatial domain is discretized using a face based staggered unstructured mesh. For the computation of the advection and diffusion terms, two different algorithms are presented i) a purely Eulerian explicit upwind type scheme and ii) a semi Lagrangian approach. The first methodology leads to a conservative scheme whose major drawback is the time step restriction imposed by the CFL stability condition. On the contrary, computational efficiency can be notably improved relying on a semi Lagrangian approach. This method leads to an unconditionally stable scheme if the diffusive terms are discretized implicitly. Once the advection and diffusion contributions have been computed, the pressure Poisson equation is solved and the velocity is updated. As a second model for the computation of buoyancy driven flows, we also consider the full compressible Navier Stokes equations. The staggered semi implicit DG method first proposed in TD17 for all Mach number flows is properly extended to account for the gravity source terms arising in the momentum and energy conservation laws. The validity and the robustness of our novel class of staggered semi implicit DG schemes is assessed at the aid of several classical benchmark problems, showing in all cases a good agreement with available numerical reference data. Finally, a detailed comparison between the incompressible and the compressible solver is presented.


A Reinforcement Learning Approach for Rebalancing Electric Vehicle Sharing Systems. This paper proposes a reinforcement learning approach for nightly offline rebalancing operations in free floating electric vehicle sharing systems (FFEVSS). Due to sparse demand in a network, FFEVSS require relocation of electrical vehicles (EVs) to charging stations and demander nodes, which is typically done by a group of drivers. A shuttle is used to pick up and drop off drivers throughout the network. The objective of this study is to solve the shuttle routing problem to finish the rebalancing work in the minimal time. We consider a reinforcement learning framework for the problem, in which a central controller determines the routing policies of a fleet of multiple shuttles. We deploy a policy gradient method for training recurrent neural networks and compare the obtained policy results with heuristic solutions. Our numerical studies show that unlike the existing solutions in the literature, the proposed methods allow to solve the general version of the problem with no restrictions on the urban EV network structure and charging requirements of EVs. Moreover, the learned policies offer a wide range of flexibility resulting in a significant reduction in the time needed to rebalance the network.


Highly irregular orbits for subshifts of finite type large intersections and emergence. In their recent paper KNS2019 , the first author, S. Kiriki, and T. Soma introduced a concept of pointwise emergence to measure the complexity of irregular orbits. They constructed a residual subset of the full shift with high pointwise emergence. In this paper we consider the set of points with high pointwise emergence for topologically mixing subshifts of finite type. We show that this set has full topological entropy, full Hausdorff dimension, and full topological pressure for any H "older continuous potential. Furthermore, we show that this set belongs to a certain class of sets with large intersection property. This is a natural generalization of FP2011 to pointwise emergence and Carath 'eodory dimension.


An L 2 T error bound for time limited balanced truncation. Model order reduction (MOR) is often applied to spatially discretized partial differential equations to reduce their order and hence decrease computational complexity. A reduced system can be obtained, e.g., by time limited balanced truncation, a method that aims to construct an accurate reduced order model on a given finite time interval 0, T . This particular balancing related MOR technique is studied in this paper. An L 2 T error bound based on the truncated time limited singular values is proved and is the main result of this paper. The derived error bound converges (as T rightarrow infty ) to the well known mathcal H infty error bound of unrestricted balanced truncation, a scheme that is used to construct a good reduced system on the entire time line. The techniques within the proofs of this paper can also be applied to unrestricted balanced truncation so that a relatively short time domain proof of the mathcal H infty error bound is found here.


Tigris Architecture and Algorithms for 3D Perception in Point Clouds. Machine perception applications are increasingly moving toward manipulating and processing 3D point cloud. This paper focuses on point cloud registration, a key primitive of 3D data processing widely used in high level tasks such as odometry, simultaneous localization and mapping, and 3D reconstruction. As these applications are routinely deployed in energy constrained environments, real time and energy efficient point cloud registration is critical. We present Tigris, an algorithm architecture co designed system specialized for point cloud registration. Through an extensive exploration of the registration pipeline design space, we find that, while different design points make vastly different trade offs between accuracy and performance, KD tree search is a common performance bottleneck, and thus is an ideal candidate for architectural specialization. While KD tree search is inherently sequential, we propose an acceleration amenable data structure and search algorithm that exposes different forms of parallelism of KD tree search in the context of point cloud registration. The co designed accelerator systematically exploits the parallelism while incorporating a set of architectural techniques that further improve the accelerator efficiency. Overall, Tigris achieves 77.2 times speedup and 7.4 times power reduction in KD tree search over an RTX 2080 Ti GPU, which translates to a 41.7 registration performance improvements and 3.0 times power reduction.


Exploiting No Regret Algorithms in System Design. We investigate a repeated two player zero sum game setting where the column player is also a designer of the system, and has full control on the design of the payoff matrix. In addition, the row player uses a no regret algorithm to efficiently learn how to adapt their strategy to the column player's behaviour over time in order to achieve good total payoff. The goal of the column player is to guide her opponent to pick a mixed strategy which is favourable for the system designer. Therefore, she needs to (i) design an appropriate payoff matrix A whose unique minimax solution contains the desired mixed strategy of the row player and (ii) strategically interact with the row player during a sequence of plays in order to guide her opponent to converge to that desired behaviour. To design such a payoff matrix, we propose a novel solution that provably has a unique minimax solution with the desired behaviour. We also investigate a relaxation of this problem where uniqueness is not required, but all the minimax solutions have the same mixed strategy for the row player. Finally, we propose a new game playing algorithm for the system designer and prove that it can guide the row player, who may play a emph stable no regret algorithm, to converge to a minimax solution.


Urdu English Machine Transliteration using Neural Networks. Machine translation has gained much attention in recent years. It is a sub field of computational linguistic which focus on translating text from one language to other language. Among different translation techniques, neural network currently leading the domain with its capabilities of providing a single large neural network with attention mechanism, sequence to sequence and long short term modelling. Despite significant progress in domain of machine translation, translation of out of vocabulary words(OOV) which include technical terms, named entities, foreign words are still a challenge for current state of art translation systems, and this situation becomes even worse while translating between low resource languages or languages having different structures. Due to morphological richness of a language, a word may have different meninges in different context. In such scenarios, translation of word is not only enough in order provide the correct quality translation. Transliteration is a way to consider the context of word sentence during translation. For low resource language like Urdu, it is very difficult to have find parallel corpus for transliteration which is large enough to train the system. In this work, we presented transliteration technique based on Expectation Maximization (EM) which is un supervised and language independent. Systems learns the pattern and out of vocabulary (OOV) words from parallel corpus and there is no need to train it on transliteration corpus explicitly. This approach is tested on three models of statistical machine translation (SMT) which include phrasebased, hierarchical phrase based and factor based models and two models of neural machine translation which include LSTM and transformer model.


MoverScore Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance. A robust evaluation metric has a profound impact on the development of text generation systems. A desirable metric compares system output against references based on their semantics rather than surface forms. In this paper we investigate strategies to encode system and reference texts to devise a metric that shows a high correlation with human judgment of text quality. We validate our new metric, namely MoverScore, on a number of text generation tasks including summarization, machine translation, image captioning, and data to text generation, where the outputs are produced by a variety of neural and non neural systems. Our findings suggest that metrics combining contextualized representations with a distance measure perform the best. Such metrics also demonstrate strong generalization capability across tasks. For ease of use we make our metrics available as web service.


Haploid Diploid Evolution Nature's Memetic Algorithm. This paper uses a recent explanation for the fundamental haploid diploid lifecycle of eukaryotic organisms to present a new memetic algorithm that differs from all previous known work using diploid representations. A form of the Baldwin effect has been identified as inherent to the evolutionary mechanisms of eukaryotes and a simplified version is presented here which maintains such behaviour. Using a well known abstract tuneable model, it is shown that varying fitness landscape ruggedness varies the benefit of haploid diploid algorithms. Moreover, the methodology is applied to optimise the targeted delivery of a therapeutic compound utilizing nano particles to cancerous tumour cells with the multicellular simulator PhysiCell.


Learning Graph Neural Networks with Approximate Gradient Descent. The first provably efficient algorithm for learning graph neural networks (GNNs) with one hidden layer for node information convolution is provided in this paper. Two types of GNNs are investigated, depending on whether labels are attached to nodes or graphs. A comprehensive framework for designing and analyzing convergence of GNN training algorithms is developed. The algorithm proposed is applicable to a wide range of activation functions including ReLU, Leaky ReLU, Sigmod, Softplus and Swish. It is shown that the proposed algorithm guarantees a linear convergence rate to the underlying true parameters of GNNs. For both types of GNNs, sample complexity in terms of the number of nodes or the number of graphs is characterized. The impact of feature dimension and GNN structure on the convergence rate is also theoretically characterized. Numerical experiments are further provided to validate our theoretical analysis.


The orthogonal complement of the Hilbert space associated to holomorphic Hermite polynomials. We study the orthogonal complement of the Hilbert subspace considered by by van Eijndhoven and Meyers in J. Math. Anal. Appl. 146 (1990), no. 1, 89 98 and associated to holomorphic Hermite polynomials. A polyanalytic orthonormal basis is given and the explicit expressions of the corresponding reproducing kernel functions and Segal Bargmann integral transforms are provided.


A Note on Optimization Formulations of Markov Decision Processes. This note summarizes the optimization formulations used in the study of Markov decision processes. We consider both the discounted and undiscounted processes under the standard and the entropy regularized settings. For each setting, we first summarize the primal, dual, and primal dual problems of the linear programming formulation. We then detail the connections between these problems and other formulations for Markov decision processes such as the Bellman equation and the policy gradient method.


Numerical study of Zakharov Kuznetsov equations in two dimensions. We present a detailed numerical study of solutions to the (generalized) Zakharov Kuznetsov equation in two spatial dimensions with various power nonlinearities. In the L 2 subcritical case, numerical evidence is presented for the stability of solitons and the soliton resolution for generic initial data. In the L 2 critical and supercritical cases, solitons appear to be unstable against both dispersion and blow up. It is conjectured that blow up happens in finite time and that blow up solutions have some resemblance of being self similar, i.e., the blow up core forms a rightward moving self similar type rescaled profile with the blow up happening at infinity in the critical case and at a finite location in the supercritical case. In the L 2 critical case, the blow up appears to be similar to the one in the L 2 critical generalized Korteweg de Vries equation with the profile being a dynamically rescaled soliton.


On Richtmyer Meshkov unstable dynamics of three dimensional interfacial coherent structures with time dependent acceleration. Richtmyer Meshkov instability (RMI) plays an important role in many areas of science and engineering, from supernovae and fusion to scramjets and nano fabrication. Classical Richtmyer Meshkov instability is induced by a steady shock and impulsive acceleration, whereas in realistic environments the acceleration is usually variable. We focus on RMI induced by acceleration with power law time dependence and apply group theory to solve the long standing problem. For early time dynamics, we find the dependence of the growth rate on the initial conditions and show that it is independent of the acceleration parameters. For late time dynamics, we find a continuous family of regular asymptotic solutions, including their curvature, velocity, Fourier amplitudes, and interfacial shear, and we study their stability. For each solution, the interface dynamics is directly linked to the interfacial shear, the non equilibrium velocity field has intense fluid motion near the interface and effectively no motion in the bulk. The quasi invariance of the fastest stable solution suggests that nonlinear coherent dynamics in RMI is characterized by two macroscopic length scales the wavelength and the amplitude, in agreement with observations. The properties of a number of special solutions are outlined, these being respectively, the Atwood, Taylor, convergence, minimum shear, and critical bubbles, among others. We also elaborate new theory benchmarks for future experiments and simulations.


The Blessing and the Curse of the Noise behind Facial Landmark Annotations. The evolving algorithms for 2D facial landmark detection empower people to recognize faces, analyze facial expressions, etc. However, existing methods still encounter problems of unstable facial landmarks when applied to videos. Because previous research shows that the instability of facial landmarks is caused by the inconsistency of labeling quality among the public datasets, we want to have a better understanding of the influence of annotation noise in them. In this paper, we make the following contributions 1) we propose two metrics that quantitatively measure the stability of detected facial landmarks, 2) we model the annotation noise in an existing public dataset, 3) we investigate the influence of different types of noise in training face alignment neural networks, and propose corresponding solutions. Our results demonstrate improvements in both accuracy and stability of detected facial landmarks.


Blocks of Ariki Koike algebras as a superlevel set for the weight function. We study a natural generalisation of Fayers's definition of the weight of a multipartition. In level one we prove that the set of all blocks, where the size of the partition varies, can be seen as a 0 superlevel set for the generalised weight function. In higher levels, we use the notion of core block, as introduced by Fayers, to prove that the set of blocks contains a superlevel set (with infinite cardinality) for the generalised weight function. We apply the result in level one to study a shift operation on partitions.


On cyclic Schur positive sets of permutation. We introduce a notion of em cyclic Schur positivity for sets of permutations, which naturally extends the classical notion of Schur positivity, and it involves the existence of a bijection from permutations to standard Young tableaux that preserves the cyclic descent set. Cyclic Schur positive sets of permutations are always Schur positive, but the converse does not hold, as exemplified by inverse descent classes, Knuth classes and conjugacy classes. In this paper we show that certain classes of permutations invariant under either horizontal or vertical rotation are cyclic Schur positive. The proof unveils a new equidistribution phenomenon of descent sets on permutations, provides affirmative solutions to conjectures from 9 and 2 , and yields new examples of Schur positive sets.


Apache Spark Accelerated Deep Learning Inference for Large Scale Satellite Image Analytics. The shear volumes of data generated from earth observation and remote sensing technologies continue to make major impact leaping key geospatial applications into the dual data and compute intensive era. As a consequence, this rapid advancement poses new computational and data processing challenges. We implement a novel remote sensing data flow (RESFlow) for advanced machine learning and computing with massive amounts of remotely sensed imagery. The core contribution is partitioning massive amount of data based on the spectral and semantic characteristics for distributed imagery analysis. RESFlow takes advantage of both a unified analytics engine for large scale data processing and the availability of modern computing hardware to harness the acceleration of deep learning inference on expansive remote sensing imagery. The framework incorporates a strategy to optimize resource utilization across multiple executors assigned to a single worker. We showcase its deployment across computationally and data intensive on pixel level labeling workloads. The pipeline invokes deep learning inference at three stages during deep feature extraction, deep metric mapping, and deep semantic segmentation. The tasks impose compute intensive and GPU resource sharing challenges motivating for a parallelized pipeline for all execution steps. By taking advantage of Apache Spark, Nvidia DGX1, and DGX2 computing platforms, we demonstrate unprecedented compute speed ups for deep learning inference on pixel labeling workloads processing 21,028 Terrabytes of imagery data and delivering an output maps at area rate of 5.245sq.km sec, amounting to 453,168 sq.km day reducing a 28 day workload to 21 hours.


Stochastic Gradient Descent with Polyak's Learning Rate. Stochastic gradient descent (SGD) for strongly convex functions converges at the rate bO(1 k) . However, achieving good results in practice requires tuning the parameters (for example the learning rate) of the algorithm. In this paper we propose a generalization of the Polyak step size, used for subgradient methods, to Stochastic gradient descent. We prove a non asymptotic convergence at the rate bO(1 k) with a rate constant which can be better than the corresponding rate constant for optimally scheduled SGD. We demonstrate that the method is effective in practice, and on convex optimization problems and on training deep neural networks, and compare to the theoretical rate.


A CNN Framenwork Based on Line Annotations for Detecting Nematodes in Microscopic Images. Plant parasitic nematodes cause damage to crop plants on a global scale. Robust detection on image data is a prerequisite for monitoring such nematodes, as well as for many biological studies involving the nematode C. elegans, a common model organism. Here, we propose a framework for detecting worm shaped objects in microscopic images that is based on convolutional neural networks (CNNs). We annotate nematodes with curved lines along the body, which is more suitable for worm shaped objects than bounding boxes. The trained model predicts worm skeletons and body endpoints. The endpoints serve to untangle the skeletons from which segmentation masks are reconstructed by estimating the body width at each location along the skeleton. With light weight backbone networks, we achieve 75.85 precision, 73.02 recall on a potato cyst nematode data set and 84.20 precision, 85.63 recall on a public C. elegans data set.


Pulsed RF Schemes for Tearing Mode Stabilization. The RF stabilization of tearing modes with current condensation has the potential to increase stabilization efficiency and loosen power localization requirements. Such benefits stem from the cooperative feedback between the RF deposition and resulting island temperature perturbation governed by diffusion. A self consistent treatment of the damping of an rf ray as it traverses the island shows that low damping scenarios can require unfavorably high powers to overcome initial power leakage and effectively capitalize on the nonlinear effect. In this work it is demonstrated that for such regimes,modulated stabilization schemes can achieve significant improvements in heating and current drive contributions to stabilization for the same average power as a continuous wave scheme. The impact of modulation frequency and duty cycle on the performance is explored, the results of which suggest modulation strategies in which the pulsing periods are kept on the order of a diffusive time.


Infinite Grid Exploration by Disoriented Robots. We deal with a set of autonomous robots moving on an infinite grid. Those robots are opaque, have limited visibility capabilities, and run using synchronous Look Compute Move cycles. They all agree on a common chirality, but have no global compass. Finally, they may use lights of different colors, but except from that, robots have neither persistent memories, nor communication mean. We consider the infinite grid exploration (IGE) problem. For this problem we give two impossibility results and three algorithms, including one which is optimal in terms of number of robots. In more detail, we first show that two robots are not sufficient in our settings to solve the problem, even when robots have a common coordinate system. We then show that if the robots' coordinate systems are not self consistent, three or four robots are not sufficient to solve the problem. Finally, we present three algorithms that solve the IGE problem in various settings. The first algorithm uses six robots with constant colors and a visibility range of one. The second one uses the minimum number of robots, i.e., five, as well as five modifiable colors, still under visibility one. The last algorithm requires seven oblivious anonymous robots, yet assuming visibility two. Notice that the two last algorithms also satisfy achieve exclusiveness.


Incomplete Descriptor Mining with Elastic Loss for Person Re Identification. In this paper, we propose a novel person Re ID model, Consecutive Batch DropBlock Network (CBDB Net), to capture the attentive and robust person descriptor for the person Re ID task. The CBDB Net contains two novel designs the Consecutive Batch DropBlock Module (CBDBM) and the Elastic Loss (EL). In the Consecutive Batch DropBlock Module (CBDBM), we firstly conduct uniform partition on the feature maps. And then, we independently and continuously drop each patch from top to bottom on the feature maps, which can output multiple incomplete feature maps. In the training stage, these multiple incomplete features can better encourage the Re ID model to capture the robust person descriptor for the Re ID task. In the Elastic Loss (EL), we design a novel weight control item to help the Re ID model adaptively balance hard sample pairs and easy sample pairs in the whole training process. Through an extensive set of ablation studies, we verify that the Consecutive Batch DropBlock Module (CBDBM) and the Elastic Loss (EL) each contribute to the performance boosts of CBDB Net. We demonstrate that our CBDB Net can achieve the competitive performance on the three standard person Re ID datasets (the Market 1501, the DukeMTMC Re ID, and the CUHK03 dataset), three occluded Person Re ID datasets (the Occluded DukeMTMC, the Partial REID, and the Partial iLIDS dataset), and a general image retrieval dataset (In Shop Clothes Retrieval dataset).


Attentive CT Lesion Detection Using Deep Pyramid Inference with Multi Scale Booster. Accurate lesion detection in computer tomography (CT) slices benefits pathologic organ analysis in the medical diagnosis process. More recently, it has been tackled as an object detection problem using the Convolutional Neural Networks (CNNs). Despite the achievements from off the shelf CNN models, the current detection accuracy is limited by the inability of CNNs on lesions at vastly different scales. In this paper, we propose a Multi Scale Booster (MSB) with channel and spatial attention integrated into the backbone Feature Pyramid Network (FPN). In each pyramid level, the proposed MSB captures fine grained scale variations by using Hierarchically Dilated Convolutions (HDC). Meanwhile, the proposed channel and spatial attention modules increase the network's capability of selecting relevant features response for lesion detection. Extensive experiments on the DeepLesion benchmark dataset demonstrate that the proposed method performs superiorly against state of the art approaches.


On the equivalence between Value at Risk and Expected Shortfall in non concave optimization. This paper studies an optimal asset allocation problem for a surplus driven financial institution facing a Value at Risk (VaR) or an Expected Shortfall (ES) constraint corresponding to a non concave optimization problem under constraints. We obtain the closed form optimal wealth with the ES constraint as well as with the VaR constraint respectively, and explicitly calculate the optimal trading strategy for constant relative risk aversion (CRRA) utility functions. We find that both VaR and ES based regulation can effectively reduce the probability of default for a surplus driven financial institution. However, the liability holders' benefits cannot be fully protected under either VaR or ES based regulation. In addition, we show that the VaR and ES based regulation can induce the same optimal portfolio choice for a surplus driven financial institution. This differs from the conclusion drawn in Basak and Shapiro 2001 where the financial institution aims at maximizing the expected utility of the total assets, and ES provides better loss protection.


Towards Better Driver Safety Empowering Personal Navigation Technologies with Road Safety Awareness. Recent research has found that navigation systems usually assume that all roads are equally safe, directing drivers to dangerous routes, which led to catastrophic consequences. To address this problem, this paper aims to begin the process of adding road safety awareness to navigation systems. To do so, we first created a definition for road safety that navigation systems can easily understand by adapting well established safety standards from transportation studies. Based on this road safety definition, we then developed a machine learning based road safety classifier that predicts the safety level for road segments using a diverse feature set constructed only from large scale publicly available geographic data. Evaluations in four different countries show that our road safety classifier achieves satisfactory performance. Finally, we discuss the factors to consider when extending our road safety classifier to other regions and potential new safety designs enabled by our road safety predictions.


PyRep Bringing V REP to Deep Robot Learning. PyRep is a toolkit for robot learning research, built on top of the virtual robotics experimentation platform (V REP). Through a series of modifications and additions, we have created a tailored version of V REP built with robot learning in mind. The new PyRep toolkit offers three improvements (1) a simple and flexible API for robot control and scene manipulation, (2) a new rendering engine, and (3) speed boosts upwards of 10,000x in comparison to the previous Python Remote API. With these improvements, we believe PyRep is the ideal toolkit to facilitate rapid prototyping of learning algorithms in the areas of reinforcement learning, imitation learning, state estimation, mapping, and computer vision.