COEBA A Coevolutionary Bat Algorithm for Discrete Evolutionary Multitasking. Multitasking optimization is an emerging research field which has attracted lot of attention in the scientific community. The main purpose of this paradigm is how to solve multiple optimization problems or tasks simultaneously by conducting a single search process. The main catalyst for reaching this objective is to exploit possible synergies and complementarities among the tasks to be optimized, helping each other by virtue of the transfer of knowledge among them (thereby being referred to as Transfer Optimization). In this context, Evolutionary Multitasking addresses Transfer Optimization problems by resorting to concepts from Evolutionary Computation for simultaneous solving the tasks at hand. This work contributes to this trend by proposing a novel algorithmic scheme for dealing with multitasking environments. The proposed approach, coined as Coevolutionary Bat Algorithm, finds its inspiration in concepts from both co evolutionary strategies and the metaheuristic Bat Algorithm. We compare the performance of our proposed method with that of its Multifactorial Evolutionary Algorithm counterpart over 15 different multitasking setups, composed by eight reference instances of the discrete Traveling Salesman Problem. The experimentation and results stemming therefrom support the main hypothesis of this study the proposed Coevolutionary Bat Algorithm is a promising meta heuristic for solving Evolutionary Multitasking scenarios.


Enabling Humans to Plan Inspection Paths Using a Virtual Reality Interface. In this work, we investigate whether humans can manually generate high quality robot paths for optical inspections. Typically, automated algorithms are used to solve the inspection planning problem. The use of automated algorithms implies that specialized knowledge from users is needed to set up the algorithm. We aim to replace this need for specialized experience, by entrusting a non expert human user with the planning task. We augment this user with intuitive visualizations and interactions in virtual reality. To investigate if humans can generate high quality inspection paths, we perform a user study in which users from different experience categories, generate inspection paths with the proposed virtual reality interface. From our study, it can be concluded that users without experience can generate high quality inspection paths The median inspection quality of user generated paths ranged between 66 81 of the quality of a state of the art automated algorithm on various inspection planning scenarios. We noticed however, a sizable variation in the performance of users, which is a result of some typical user behaviors. These behaviors are discussed, and possible solutions are provided.


Transformers as Soft Reasoners over Language. Beginning with McCarthy's Advice Taker (1959), AI has pursued the goal of providing a system with explicit, general knowledge and having the system reason over that knowledge. However, expressing the knowledge in a formal (logical or probabilistic) representation has been a major obstacle to this research. This paper investigates a modern approach to this problem where the facts and rules are provided as natural language sentences, thus bypassing a formal representation. We train transformers to reason (or emulate reasoning) over these sentences using synthetically generated data. Our models, that we call RuleTakers, provide the first empirical demonstration that this kind of soft reasoning over language is learnable, can achieve high (99 ) accuracy, and generalizes to test data requiring substantially deeper chaining than seen during training (95 scores). We also demonstrate that the models transfer well to two hand authored rulebases, and to rulebases paraphrased into more natural language. These findings are significant as it suggests a new role for transformers, namely as limited "soft theorem provers" operating over explicit theories in language. This in turn suggests new possibilities for explainability, correctability, and counterfactual reasoning in question answering.


Dynamical reweighting methods for Markov models. Markov State Models (MSM) are widely used to elucidate dynamic properties of molecular systems from unbiased Molecular Dynamics (MD). However, the implementation of reweighting schemes for MSMs to analyze biased simulations, for example produced by enhanced sampling techniques, is still at an early stage of development. Several dynamical reweighing approaches have been proposed, which can be classified as approaches based on (i) Kramers rate theory, (ii) rescaling of the probability density flux, (iii) reweighting by formulating a likelihood function, (iv) path reweighting. We present the state of the art and discuss the methodological differences of these methods, their limitations and recent applications.


Precise large deviations for dependent subexponential variables. In this paper we study precise large deviations for the partial sums of a stationary sequence with a subexponential marginal distribution. Our main focus is on distributions which either have a regularly varying or a lognormal type tail. We apply the results to prove limit theory for the maxima of the entries large sample covariance matrices.


On the Compositionality of Dynamic Leakage and Its Application to the Quantification Problem. Quantitative information flow (QIF) is traditionally defined as the expected value of information leakage over all feasible program runs and it fails to identify vulnerable programs where only limited number of runs leak large amount of information. As discussed in Bielova (2016), a good notion for dynamic leakage and an efficient way of computing the leakage are needed. To address this problem, the authors have already proposed two notions for dynamic leakage and a method of quantifying dynamic leakage based on model counting. Inspired by the work of Kawamoto et. al. (2017), this paper proposes two efficient methods for computing dynamic leakage, a compositional method along with the sequential structure of a program and a parallel computation based on the value domain decomposition. For the former, we also investigate both exact and approximated calculations. From the perspective of implementation, we utilize binary decision diagrams (BDDs) and deterministic decomposable negation normal forms (d DNNFs) to represent Boolean formulas in model counting. Finally, we show experimental results on several examples.


Better Patch Stitching for Parametric Surface Reconstruction. Recently, parametric mappings have emerged as highly effective surface representations, yielding low reconstruction error. In particular, the latest works represent the target shape as an atlas of multiple mappings, which can closely encode object parts. Atlas representations, however, suffer from one major drawback The individual mappings are not guaranteed to be consistent, which results in holes in the reconstructed shape or in jagged surface areas. We introduce an approach that explicitly encourages global consistency of the local mappings. To this end, we introduce two novel loss terms. The first term exploits the surface normals and requires that they remain locally consistent when estimated within and across the individual mappings. The second term further encourages better spatial configuration of the mappings by minimizing novel stitching error. We show on standard benchmarks that the use of normal consistency requirement outperforms the baselines quantitatively while enforcing better stitching leads to much better visual quality of the reconstructed objects as compared to the state of the art.


Searching for small world and scale free behaviour in long term historical data of a real world power grid. In this paper the authors use the 70 year long historical dataset of the Hungarian power grid to perform complex network analysis, which is the first attempt to evaluate small world and scale free properties on long term real world data.


Efficient Reordered Nonlinear Gauss Seidel Solvers With Higher Order For Black Oil Models. The fully implicit method is the most commonly used approach to solve black oil problems in reservoir simulation. The method requires repeated linearization of large nonlinear systems and produces ill condi tioned linear systems. We present a strategy to reduce computational time that relies on two key ideas ( textit i ) a sequential formulation that decouples flow and transport into separate subproblems, and ( textit ii ) a highly efficient Gauss Seidel solver for the transport problems. This solver uses intercell fluxes to reorder the grid cells according to their upstream neighbors, and groups cells that are mutually dependent because of counter current flow into local clusters. The cells and local clusters can then be solved in sequence, starting from the inflow and moving gradually downstream, since each new cell or local cluster will only depend on upstream neighbors that have already been computed. Altogether, this gives optimal localization and control of the nonlinear solution process. This method has been successfully applied to real field problems using the standard first order finite volume discretization. Here, we extend the idea to first order dG methods on fully unstructured grids. We also demonstrate proof of concept for the reordering idea by applying it to the full simulation model of the Norne oil field, using a prototype variant of the open source OPM Flow simulator.


Microalgal swimming signatures as indicators of neutral lipids production across growth phases. Microalgae have been shown as a potential bioresource for food, biofuel, and pharmaceutical products. During the growth phases with corresponding environmental conditions, microalgae accumulate different amounts of various metabolites. We quantified the lipid accumulation and analyzed swimming signatures (speed and trajectories) of the motile green alga, Dunaliella primolecta, during the lag exponential stationary growth cycle at different nutrient concentrations. We discovered significant changes in neutral lipid content and swimming signatures of microalgae across growth phases. The timing of the maximum swimming speed coincided with the maximum lipid content and both maxima occurred under nutrient stress at the stationary growth phase. Furthermore, the swimming trajectories of microalgae signal the growth phase and corresponding intracellular lipid accumulation. Our results provide the potential exploitation of microalgal swimming signatures as indicators for the cultivation conditions and the timing of microalgal harvest to maximize the lipid yield for biofuel production. The findings can also be implemented to explore the production of food and antibiotics from other microalgal metabolites with low energy cost.


DNNExplorer A Framework for Modeling and Exploring a Novel Paradigm of FPGA based DNN Accelerator. Existing FPGA based DNN accelerators typically fall into two design paradigms. Either they adopt a generic reusable architecture to support different DNN networks but leave some performance and efficiency on the table because of the sacrifice of design specificity. Or they apply a layer wise tailor made architecture to optimize layer specific demands for computation and resources but loose the scalability of adaptation to a wide range of DNN networks. To overcome these drawbacks, this paper proposes a novel FPGA based DNN accelerator design paradigm and its automation tool, called DNNExplorer, to enable fast exploration of various accelerator designs under the proposed paradigm and deliver optimized accelerator architectures for existing and emerging DNN networks. Three key techniques are essential for DNNExplorer's improved performance, better specificity, and scalability, including (1) a unique accelerator design paradigm with both high dimensional design space support and fine grained adjustability, (2) a dynamic design space to accommodate different combinations of DNN workloads and targeted FPGAs, and (3) a design space exploration (DSE) engine to generate optimized accelerator architectures following the proposed paradigm by simultaneously considering both FPGAs' computation and memory resources and DNN networks' layer wise characteristics and overall complexity. Experimental results show that, for the same FPGAs, accelerators generated by DNNExplorer can deliver up to 4.2x higher performances (GOP s) than the state of the art layer wise pipelined solutions generated by DNNBuilder for VGG like DNN with 38 CONV layers. Compared to accelerators with generic reusable computation units, DNNExplorer achieves up to 2.0x and 4.4x DSP efficiency improvement than a recently published accelerator design from academia (HybridDNN) and a commercial DNN accelerator IP (Xilinx DPU), respectively.


On the difference of coefficients of univalent functions. For f in mathcal S , the class of normalized functions, analytic and univalent in the unit disk mathbb D and given by f(z) z sum n 2 infty a n z n for z in mathbb D , we give an upper bound for the coefficient difference a 4 a 3 when f in mathcal S . This provides an improved bound in the case n 3 of Grispan's 1976 general bound a n 1 a n le 3.61 dots . Other coefficients bounds, and bounds for the second and third Hankel determinants when f in mathcal S are found when either a 2 0, or a 3 0 .


Adapting Stable Matchings to Evolving Preferences. Adaptivity to changing environments and constraints is key to success in modern society. We address this by proposing "incrementalized versions" of Stable Marriage and Stable Roommates. That is, we try to answer the following question for both problems, what is the computational cost of adapting an existing stable matching after some of the preferences of the agents have changed. While doing so, we also model the constraint that the new stable matching shall be not too different from the old one. After formalizing these incremental versions, we provide a fairly comprehensive picture of the computational complexity landscape of Incremental Stable Marriage and Incremental Stable Roommates. To this end, we exploit the parameters "degree of change" both in the input (difference between old and new preference profile) and in the output (difference between old and new stable matching). We obtain both hardness and tractability results, in particular showing a fixed parameter tractability result with respect to the parameter "distance between old and new stable matching".


Predicting Breakdowns in Cloud Services (with SPIKE). Maintaining web services is a mission critical task where any down time means loss of revenue and reputation (of being a reliable service provider). In the current competitive web services market, such a loss of reputation causes extensive loss of future revenue. To address this issue, we developed SPIKE, a data mining tool which can predict upcoming service breakdowns, half an hour into the future. Such predictions let an organization alert and assemble the tiger team to address the problem (e.g. by reconfiguring cloud hardware in order to reduce the likelihood of that breakdown). SPIKE utilizes (a) regression tree learning (with CART) (b) synthetic minority over sampling (to handle how rare spikes are in our data) (c) hyperparameter optimization (to learn best settings for our local data) and (d) a technique we called "topology sampling" where training vectors are built from extensive details of an individual node plus summary details on all their neighbors. In the experiments reported here, SPIKE predicted service spikes 30 minutes into future with recalls and precision of 75 and above. Also, SPIKE performed relatively better than other widely used learning methods (neural nets, random forests, logistic regression).


Semigroups of composition operators in analytic Morrey spaces. Analytic Morrey spaces belong to the class of function spaces which, like BMOA, are defined in terms of the degree of oscillation on the boundary of functions analytic in the unit disc. We consider semigroups of composition operators on these spaces and focus on the question of strong continuity. It is shown that these semigroups behave like on BMOA.


Uncertainty Principles for the Fourier and the Short Time Fourier Transforms. The aim of this paper is to establish a few uncertainty principles for the Fourier and the short time Fourier transforms. Also, we discuss an analogue of Donoho Stark uncertainty principle and provide some estimates for the size of the essential support of the short time Fourier transform.


Quadratization of ODEs Monomial vs. Non Monomial. Quadratization is a transform of a system of ODEs with polynomial right hand side into a system of ODEs with at most quadratic right hand side via the introduction of new variables. It has been recently used as a pre processing step for new model order reduction methods, so it is important to keep the number of new variables small. Several algorithms have been designed to search for a quadratization with the new variables being monomials in the original variables. To understand the limitations and potential ways of improving such algorithms, we study the following question can quadratizations with not necessarily monomial new variables produce a model of substantially smaller dimension than quadratization with only monomial new variables? To do this, we restrict our attention to scalar polynomial ODEs. Our first result is that a scalar polynomial ODE dot x p(x) a nx n a n 1 x n 1 ldots a 0 with n geqslant 5 and a n neq0 can be quadratized using exactly one new variable if and only if p(x frac a n 1 n cdot a n ) a nx n ax 2 bx for some a, b in mathbb C . In fact, the new variable can be taken z (x frac a n 1 n cdot a n ) n 1 . Our second result is that two non monomial new variables are enough to quadratize all degree 6 scalar polynomial ODEs. Based on these results, we observe that a quadratization with not necessarily monomial new variables can be much smaller than a monomial quadratization even for scalar ODEs. The main results of the paper have been discovered using computational methods of applied nonlinear algebra (Gr "obner bases), and we describe these computations.


Potential diagonalisability of pseudo Barsotti Tate representations. Previous work of Kisin and Gee proves potential diagonalisability of two dimensional Barsotti Tate representations of the Galois group of a finite extension K mathbb Q p . In this paper we build upon their work by relaxing the Barsotti Tate condition to one we call pseudo Barsotti Tate (which means that for certain embeddings kappa K rightarrow overline mathbb Q p we allow the kappa Hodge Tate weights to be contained in 0,p rather than 0,1 ).


Enhancing the Erd H o s Lov 'asz Tihany Conjecture for graphs with independence number two. Let s ge2 and t ge2 be integers. A graph G is (s,t) emph splittable if V(G) can be partitioned into two sets S and T such that chi(G S ) geq s and chi(G T ) geq t . The well known Erd H o s Lov 'asz Tihany Conjecture from 1968 states that every graph G whose chromatic number chi(G) s t 1 is more than its clique number omega(G) is (s,t) splittable. In this paper, we prove an enhanced version of the Erd H o s Lov 'asz Tihany Conjecture for graphs with independence number two. That is, for every graph G with chi(G) s t 1 omega(G) 1 is (s,t 1) splittable. There are examples showing that this result is best possible.


Convolutions on Spherical Images. Applying convolutional neural networks to spherical images requires particular considerations. We look to the millennia of work on cartographic map projections to provide the tools to define an optimal representation of spherical images for the convolution operation. We propose a representation for deep spherical image inference based on the icosahedral Snyder equal area (ISEA) projection, a projection onto a geodesic grid, and show that it vastly exceeds the state of the art for convolution on spherical images, improving semantic segmentation results by 12.6 .


Regular irreducible represntations of classical groups over finite quotient rings. A parametrization of irreducible representations associated with a regular adjoint orbit of a classical group over finite quotient rings of the ring of integer of a non dyadic non archimedean local field is presented. The parametrization is given by means of (a subset of) the character group of the centralizer of a representative of the regular adjoint orbit. Our method is based upon Weil representations over finite fields. More explicit parametrization in terms of tamely ramified extensions of the base field is given for the general linear group, the special linear group, the symplectic group and the orthogonal group.


Stability results for nonlocal geometric evolutions and limit cases for fractional mean curvature flows. We introduce a notion of uniform convergence for local and nonlocal curvatures. Then, we propose an abstract method to prove the convergence of the corresponding geometric flows, within the level set formulation. We apply such a general theory to characterize the limits of s fractional mean curvature flows as s to 0 and s to 1 . In analogy with the s fractional mean curvature flows, we introduce the notion of s Riesz curvature flows and characterize its limit as s to 0 . Eventually, we discuss the limit behavior as r to 0 of the flow generated by a regularization of the r Minkowski content.


A feedforward neural network for modelling of average pressure frequency response. The Helmholtz equation has been used for modelling the sound pressure field under a harmonic load. Computing harmonic sound pressure fields by means of solving Helmholtz equation can quickly become unfeasible if one wants to study many different geometries for ranges of frequencies. We propose a machine learning approach, namely a feedforward dense neural network, for computing the average sound pressure over a frequency range. The data is generated with finite elements, by numerically computing the response of the average sound pressure, by an eigenmode decomposition of the pressure. We analyze the accuracy of the approximation and determine how much training data is needed in order to reach a certain accuracy in the predictions of the average pressure response.


Automatic Detection of Generated Text is Easiest when Humans are Fooled. Recent advancements in neural language modelling make it possible to rapidly generate vast amounts of human sounding text. The capabilities of humans and automatic discriminators to detect machine generated text have been a large source of research interest, but humans and machines rely on different cues to make their decisions. Here, we perform careful benchmarking and analysis of three popular sampling based decoding strategies top k , nucleus sampling, and untruncated random sampling and show that improvements in decoding methods have primarily optimized for fooling humans. This comes at the expense of introducing statistical abnormalities that make detection easy for automatic systems. We also show that though both human and automatic detector performance improve with longer excerpt length, even multi sentence excerpts can fool expert human raters over 30 of the time. Our findings reveal the importance of using both human and automatic detectors to assess the humanness of text generation systems.


Curved patch mapping and tracking for irregular terrain modeling Application to bipedal robot foot placement. Legged robots need to make contact with irregular surfaces, when operating in unstructured natural terrains. Representing and perceiving these areas to reason about potential contact between a robot and its surrounding environment, is still largely an open problem. This paper introduces a new framework to model and map local rough terrain surfaces, for tasks such as bipedal robot foot placement. The system operates in real time, on data from an RGB D and an IMU sensor. We introduce a set of parametrized patch models and an algorithm to fit them in the environment. Potential contacts are identified as bounded curved patches of approximately the same size as the robot's foot sole. This includes sparse seed point sampling, point cloud neighborhood search, and patch fitting and validation. We also present a mapping and tracking system, where patches are maintained in a local spatial map around the robot as it moves. A bio inspired sampling algorithm is introduced for finding salient contacts. We include a dense volumetric fusion layer for spatiotemporally tracking, using multiple depth data to reconstruct a local point cloud. We present experimental results on a mini biped robot that performs foot placements on rocks, implementing a 3D foothold perception system, that uses the developed patch mapping and tracking framework.


On measuring two party partisan bias in unbalanced states. Assuming that partisan fairness and responsiveness are important aspects of redistricting, it is important to measure them. Many measures of partisan bias are satisfactory for states that are balanced with roughly equal proportions of voters for the two major parties. It has been less clear which metrics measure fairness robustly when the proportion of the vote is unbalanced by as little as 60 to 40 . We have addressed this by analyzing past election results for four states with Democratic preferences (CA, IL, MA, and MD), three states with Republican preferences (SC, TN, and TX) and comparing those to results for four nearly balanced states (CO, NC, OH, and PA). We used many past statewide elections in each state to build statistically precise seats for votes and rank for votes graphs to which many measures of partisan bias were applied. In addition to providing values of responsiveness, we find that five of the measures of bias provide mutually consistent values in all states, thereby providing a core of usable measures for unbalanced states. Although all five measures focus on different aspects of partisan bias, normalization of the values across the eleven states provides a suitable way to compare them, and we propose that their average provides a superior measure which we call composite bias. Regarding other measures, we find that the most seemingly plausible symmetry measure fails for unbalanced states. We also consider deviations from the proportionality ideal, but using it is difficult because the political geography of a state can entangle responsiveness with total partisan bias. We do not attempt to separate intentional partisan bias from the implicit bias that results from the interaction of the map drawing rules of a state and its political geography, on the grounds that redistricting should attempt to minimize total partisan bias whatever its provenance.


Effective topological complexity of orientable surface groups. We use rewriting systems to spell out cup products in the (twisted) cohomology groups of a product of surface groups. This allows us to detect a non trivial obstruction bounding from below the effective topological complexity of an orientable surface with respect to its antipodal involution. Our estimates are at most one unit from being optimal, and are closely related to the (regular) topological complexity of non orientable surfaces.


Efficient Partial Snapshot Implementations. In this work, we propose the lambda scanner snapshot, a variation of the snapshot object, which supports any fixed amount of 0 lambda leq n different SCAN operations being active at any given time. Whenever lambda is equal to the number of processes n in the system, the lambda scanner object implements a multi scanner object, while in case that lambda is equal to 1 , the lambda scanner object implements a single scanner object. We present the lambda Snap snapshot object, a wait free lambda scanner snapshot implementation that has a step complexity of O( lambda) for UPDATE operations and O( lambda m) for SCAN operations. The space complexity of lambda Snap is O( lambda m) . lambda Snap provides a trade off between the step space complexity and the maximum number of SCAN operations that the system can afford to be active on any given point in time. The low space complexity that our implementations provide makes them more appealing in real system applications. Moreover, we provide a slightly modified version of the lambda Snap implementation, which is called partial lambda Snap , that is able to support dynamic partial scan operations. In such an object, processes can execute modified SCAN operations called PARTIAL SCAN that could obtain a part of the snapshot object avoiding to read the whole set of components. In this work, we first provide a simple single scanner version of lambda Snap , which is called 1 Snap . We provide 1 Snap just for presentation purposes, since it is simpler than lambda Snap . The UPDATE in 1 Snap has a step complexity of O(1) , while the SCAN has a step complexity of O(m) . This implementation uses O(m) CAS registers.


Ocular Recognition Databases and Competitions A Survey. The use of the iris and periocular region as biometric traits has been extensively investigated, mainly due to the singularity of the iris features and the use of the periocular region when the image resolution is not sufficient to extract iris information. In addition to providing information about an individual's identity, features extracted from these traits can also be explored to obtain other information such as the individual's gender, the influence of drug use, the use of contact lenses, spoofing, among others. This work presents a survey of the databases created for ocular recognition, detailing their protocols and how their images were acquired. We also describe and discuss the most popular ocular recognition competitions (contests), highlighting the submitted algorithms that achieved the best results using only iris trait and also fusing iris and periocular region information. Finally, we describe some relevant works applying deep learning techniques to ocular recognition and point out new challenges and future directions. Considering that there are a large number of ocular databases, and each one is usually designed for a specific problem, we believe this survey can provide a broad overview of the challenges in ocular biometrics.


PoseRBPF A Rao Blackwellized Particle Filter for 6D Object Pose Tracking. Tracking 6D poses of objects from videos provides rich information to a robot in performing different tasks such as manipulation and navigation. In this work, we formulate the 6D object pose tracking problem in the Rao Blackwellized particle filtering framework, where the 3D rotation and the 3D translation of an object are decoupled. This factorization allows our approach, called PoseRBPF, to efficiently estimate the 3D translation of an object along with the full distribution over the 3D rotation. This is achieved by discretizing the rotation space in a fine grained manner, and training an auto encoder network to construct a codebook of feature embeddings for the discretized rotations. As a result, PoseRBPF can track objects with arbitrary symmetries while still maintaining adequate posterior distributions. Our approach achieves state of the art results on two 6D pose estimation benchmarks. A video showing the experiments can be found at https youtu.be lE5gjzRKWuA


Communication Efficient Jaccard Similarity for High Performance Distributed Genome Comparisons. The Jaccard similarity index is an important measure of the overlap of two sets, widely used in machine learning, computational genomics, information retrieval, and many other areas. We design and implement SimilarityAtScale, the first communication efficient distributed algorithm for computing the Jaccard similarity among pairs of large datasets. Our algorithm provides an efficient encoding of this problem into a multiplication of sparse matrices. Both the encoding and sparse matrix product are performed in a way that minimizes data movement in terms of communication and synchronization costs. We apply our algorithm to obtain similarity among all pairs of a set of large samples of genomes. This task is a key part of modern metagenomics analysis and an evergrowing need due to the increasing availability of high throughput DNA sequencing data. The resulting scheme is the first to enable accurate Jaccard distance derivations for massive datasets, using largescale distributed memory systems. We package our routines in a tool, called GenomeAtScale, that combines the proposed algorithm with tools for processing input sequences. Our evaluation on real data illustrates that one can use GenomeAtScale to effectively employ tens of thousands of processors to reach new frontiers in large scale genomic and metagenomic analysis. While GenomeAtScale can be used to foster DNA research, the more general underlying SimilarityAtScale algorithm may be used for high performance distributed similarity computations in other data analytics application domains.


Processsing Simple Geometric Attributes with Autoencoders. Image synthesis is a core problem in modern deep learning, and many recent architectures such as autoencoders and Generative Adversarial networks produce spectacular results on highly complex data, such as images of faces or landscapes. While these results open up a wide range of new, advanced synthesis applications, there is also a severe lack of theoretical understanding of how these networks work. This results in a wide range of practical problems, such as difficulties in training, the tendency to sample images with little or no variability, and generalisation problems. In this paper, we propose to analyse the ability of the simplest generative network, the autoencoder, to encode and decode two simple geometric attributes size and position. We believe that, in order to understand more complicated tasks, it is necessary to first understand how these networks process simple attributes. For the first property, we analyse the case of images of centred disks with variable radii. We explain how the autoencoder projects these images to and from a latent space of smallest possible dimension, a scalar. In particular, we describe a closed form solution to the decoding training problem in a network without biases, and show that during training, the network indeed finds this solution. We then investigate the best regularisation approaches which yield networks that generalise well. For the second property, position, we look at the encoding and decoding of Dirac delta functions, also known as one hot' vectors. We describe a hand crafted filter that achieves encoding perfectly, and show that the network naturally finds this filter during training. We also show experimentally that the decoding can be achieved if the dataset is sampled in an appropriate manner.


On the structure of asymptotic expanders. In this paper, we use geometric tools to study the structure of asymptotic expanders and show that a sequence of asymptotic expanders always admits a "uniform exhaustion by expanders". It follows that asymptotic expanders cannot be coarsely embedded into any L p space, and that asymptotic expanders can be characterised in terms of their uniform Roe algebra. Moreover, we provide uncountably many new counterexamples to the coarse Baum Connes conjecture. These appear to be the first counterexamples that are not directly constructed by means of spectral gaps. Finally, we show that vertex transitive asymptotic expanders are actually expanders. In particular, this gives a C algebraic characterisation of expanders for vertex transitive graphs.


Global properties of vector fields on compact Lie groups in Komatsu classes. In this paper we characterize completely the global hypoellipticity and global solvability in the sense of Komatsu (of Roumieu and Beurling types) of constant coefficients vector fields on compact Lie groups. We also analyze the influence of perturbations by lower order terms in the preservation of these properties.


FusionStitching Boosting Execution Efficiency of Memory Intensive Computations for DL Workloads. Performance optimization is the art of continuous seeking a harmonious mapping between the application domain and hardware. Recent years have witnessed a surge of deep learning (DL) applications in industry. Conventional wisdom for optimizing such workloads mainly focus on compute intensive ops (GEMM, Convolution, etc). Yet we show in this work, that the performance of memory intensive computations is vital to E2E performance in practical DL models. We propose emph FusionStitching , a optimization framework capable of fusing memory intensive emph elementwise , emph reduction and fine grained emph GEMM Batched GEMM ops, with or without data dependences, into large computation units, then mapping and transforming them into efficient GPU kernels. We formulate the fusion plan optimization as an integer linear programming (ILP) problem, and propose a set of empirical heuristics to reduce the combinatorial search space. In order to map optimized fusion plans to hardware, we propose a technique to effectively compose various groups of computations into a single GPU kernel, by fully leveraging on chip resources like scratchpads or registers. Experimental results on six benchmarks and four industry scale practical models are encouraging. Overall, emph FusionStitching can reach up to 5.7x speedup compared to Tensorflow baseline, and achieves 1.25x to 1.85x performance speedups compared to current state of the art, with 1.4x on average (geometric mean).


Symbolic dynamical scales modes, orbitals, and transversals. We study classes of musical scales obtained from shift spaces in symbolic dynamics through the first symbol rule, which yields scales in any n TET tuning system. The modes are thought as elements of orbit equivalence classes of cyclic shift actions on languages, and we study their orbitals and transversals. We present explicit formulations of the generating functions that allow us to deduce the orbital and transversal dimensions of classes of musical scales generated by vertex shifts, for all n , in particular for the 12 TET tuning system.


Leveraging Decentralized Artificial Intelligence to Enhance Resilience of Energy Networks. This paper reintroduces the notion of resilience in the context of recent issues originated from climate change triggered events including severe hurricanes and wildfires. A recent example is PG E's forced power outage to contain wildfire risk which led to widespread power disruption. This paper focuses on answering two questions who is responsible for resilience? and how to quantify the monetary value of resilience? To this end, we first provide preliminary definitions of resilience for power systems. We then investigate the role of natural hazards, especially wildfire, on power system resilience. Finally, we will propose a decentralized strategy for a resilient management system using distributed storage and demand response resources. Our proposed high fidelity model provides utilities, operators, and policymakers with a clearer picture for strategic decision making and preventive decisions.


Automatic Translation of tock CSP into Timed Automata. The process algebra tock CSP provides textual notations for modelling discrete time behaviours, with the support of various tools for verification. Similarly, automatic verification of Timed Automata (TA) is supported by the real time verification toolbox UPPAAL. TA and tock CSP differ in both modelling and verification approaches. For instance, liveness requirements are difficult to specify with the constructs of tock CSP, but they are easy to verify in UPPAAL. In this work, we translate tock CSP into TA to take advantage of UPPAAL. We have developed a translation technique and tool our work uses rules for translating tock CSP into a network of small TA, which address the complexity of capturing the compositionality of tock CSP . For validation, we use an experimental approach based on finite approximations to trace sets. We plan to use mathematical proof to establish the correctness of the rules that will cover an infinite set of traces.


Long time mathcal H s alpha stability of a classical scheme for Cahn Hilliard equation with polynomial nonlinearity. In this paper we investigate the long time stability of the implicit Euler scheme for the Cahn Hilliard equation with polynomial nonlinearity. The uniform estimates in H 1 and mathcal H s alpha ( s 1,2,3 ) spaces independent of the initial data and time discrete step sizes are derived for the numerical solution produced by this classical scheme with variable time step sizes.The uniform mathcal H 3 alpha bound is obtained on basis of the uniform H 1 estimate for the discrete chemical potential which is derived with the aid of the uniform discrete Gronwall lemma. A comparison with the estimates for the continuous in time dynamical system reveals that the classical implicit Euler method can completely preserve the long time behaviour of the underlying system. Such a long time behaviour is also demonstrated by the numerical experiments with the help of Fourier pseudospectral space approximation.


On the chromatic number of almost stable general Kneser hypergraphs. Let n ge 1 and s ge 1 be integers. An almost s stable subset A of n 1, dots,n is a subset such that for any two distinct elements i, j in A , one has i j ge s . For a family cal F of non empty subsets of n and an integer r ge 2 , the chromatic number of the r uniform Kneser hypergraph mbox KG r( cal F ) , whose vertex set is cal F and whose edge set is the set of A 1, dots, A r of pairwise disjoint elements in cal F , has been studied extensively in the literature and Abyazi Sani and Alishahi were able to give a lower bound for it in terms of the equatable r colorability defect, mbox ecd r( cal F ) . In this article, the methods of Chen for the special family of all k subsets of n , are modified to give lower bounds for the chromatic number of almost stable general Kneser hypergraph mbox KG r( cal F s) in terms of mbox ecd s( cal F ) . Here cal F s is the collection of almost s stable elements of cal F . We also propose a generalization of a conjecture of Meunier.


Fast and Accurate Computation of Vertical Modes. The vertical modes of linearized equations of motion are widely used by the oceanographic community in numerous theoretical and observational contexts. However, the standard approach for solving the generalized eigenvalue problem using second order finite difference matrices produces O(1) errors for all but the few lowest modes, and increasing resolution quickly becomes too slow as the computational complexity of eigenvalue algorithms increase as O(n 3) . Existing methods are therefore inadequate for computing a full spectrum of internal waves, such as needed for initializing a numerical model with a full internal wave spectrum. Here we show that rewriting the eigenvalue problem in stretched coordinates and projecting onto Chebyshev polynomials results in substantially more accurate modes than finite differencing at a fraction of the computational cost. We also compute the surface quasigeostrophic modes using the same methods. All spectral and finite difference algorithms are made available in a suite of Matlab classes that have been validated against known analytical solutions in constant and exponential stratification.


Denseness results in the theory of algebraic fields. We study when the property that a field is dense in its real and p adic closures is elementary in the language of rings and deduce that all models of the theory of algebraic fields have this property.


P3SGD Patient Privacy Preserving SGD for Regularizing Deep CNNs in Pathological Image Classification. Recently, deep convolutional neural networks (CNNs) have achieved great success in pathological image classification. However, due to the limited number of labeled pathological images, there are still two challenges to be addressed (1) overfitting the performance of a CNN model is undermined by the overfitting due to its huge amounts of parameters and the insufficiency of labeled training data. (2) privacy leakage the model trained using a conventional method may involuntarily reveal the private information of the patients in the training dataset. The smaller the dataset, the worse the privacy leakage. To tackle the above two challenges, we introduce a novel stochastic gradient descent (SGD) scheme, named patient privacy preserving SGD (P3SGD), which performs the model update of the SGD in the patient level via a large step update built upon each patient's data. Specifically, to protect privacy and regularize the CNN model, we propose to inject the well designed noise into the updates. Moreover, we equip our P3SGD with an elaborated strategy to adaptively control the scale of the injected noise. To validate the effectiveness of P3SGD, we perform extensive experiments on a real world clinical dataset and quantitatively demonstrate the superior ability of P3SGD in reducing the risk of overfitting. We also provide a rigorous analysis of the privacy cost under differential privacy. Additionally, we find that the models trained with P3SGD are resistant to the model inversion attack compared with those trained using non private SGD.


Approximation of functions by linear summation methods in the Orlicz type spaces. Approximative properties of linear summation methods of Fourier series are considered in the Orlicz type spaces mathcal S M . In particular, in terms of approximations by such methods, constructive characteristics are obtained for classes of functions whose smoothness moduli do not exceed a certain majorant.


Algebras with Laurent polynomial identity. In this article we shows some results about algebra with the group of units having special polynomial identity.


Finite field extensions with the line or translate property for r primitive elements. Let r,n 1 be integers and q be any prime power q such that r mid q n 1 . We say that the extension mathbb F q n mathbb F q possesses the line property for r primitive elements property if, for every alpha, theta in mathbb F q n , such that mathbb F q n mathbb F q( theta) , there exists some x in mathbb F q , such that alpha( theta x) has multiplicative order (q n 1) r . We prove that, for sufficiently large prime powers q , mathbb F q n mathbb F q possesses the line property for r primitive elements. We also discuss the (weaker) translate property for extensions.


IBIR Bug Report driven Fault Injection. Much research on software engineering and software testing relies on experimental studies based on fault injection. Fault injection, however, is not often relevant to emulate real world software faults since it "blindly" injects large numbers of faults. It remains indeed challenging to inject few but realistic faults that target a particular functionality in a program. In this work, we introduce IBIR, a fault injection tool that addresses this challenge by exploring change patterns associated to user reported faults. To inject realistic faults, we create mutants by retargeting a bug report driven automated program repair system, i.e., reversing its code transformation templates. IBIR is further appealing in practice since it requires deep knowledge of neither of the code nor the tests, but just of the program's relevant bug reports. Thus, our approach focuses the fault injection on the feature targeted by the bug report. We assess IBIR by considering the Defects4J dataset. Experimental results show that our approach outperforms the fault injection performed by traditional mutation testing in terms of semantic similarity with the original bug, when applied at either system or class levels of granularity, and provides better, statistically significant, estimations of test effectiveness (fault detection). Additionally, when injecting 100 faults, IBIR injects faults that couple with the real ones in 36 of the cases, while mutants from mutation testing inject less than 1 . Overall, IBIR targets real functionality and injects realistic and diverse faults.


New examples of W and C superrigid groups. A group G is called W superrigid (resp. C superrigid) if it is completely recognizable from its von Neumann algebra L(G) (resp. reduced C algebra C r (G) ). Developing new technical aspects in Popa's deformation rigidity theory we introduce several new classes of W superrigid groups which appear as direct products, semidirect products with non amenable core and iterations of amalgamated free products and HNN extensions. As a byproduct we obtain new rigidity results in C algebra theory including additional examples of C superrigid groups and explicit computations of symmetries of reduced group C algebras.


Solvability of an Operator Riccati Integral Equation in a Reflexive Banach Space. We show that if X is a reflexive Banach space, then a nonautonomous operator Riccati integral equation has a unique strongly continuous self adjoint nonnegative solution P(t) in mathcal L (X,X )


Improving Zero Shot Translation by Disentangling Positional Information. Multilingual neural machine translation has shown the capability of directly translating between language pairs unseen in training, i.e. zero shot translation. Despite being conceptually attractive, it often suffers from low output quality. The difficulty of generalizing to new translation directions suggests the model representations are highly specific to those language pairs seen in training. We demonstrate that a main factor causing the language specific representations is the positional correspondence to input tokens. We show that this can be easily alleviated by removing residual connections in an encoder layer. With this modification, we gain up to 18.5 BLEU points on zero shot translation while retaining quality on supervised directions. The improvements are particularly prominent between related languages, where our proposed model outperforms pivot based translation. Moreover, our approach allows easy integration of new languages, which substantially expands translation coverage. By thorough inspections of the hidden layer outputs, we show that our approach indeed leads to more language independent representations.


On Chip Characterization of High Loss Liquids between 750 GHz and 1100 GHz. Terahertz spectroscopy is a promising tool for analyzing the picosecond dynamics of biomolecules, which is influenced by surrounding water molecules. However, water causes extreme losses to terahertz signals, preventing sensitive measurements at this frequency range. Here, we present sensitive on chip terahertz spectroscopy of highly lossy aqueous solutions using a vector network analyzer, contact probes, and a coplanar waveguide with a 0.1 mm wide microfluidic channel. The complex permittivities of various deionized water isopropyl alcohol concentration are extracted from a known reference measurement across the frequency range 750 1100 GHz and agrees well with literature data. The results prove the presented method as a high sensitive approach for on chip terahertz spectroscopy of high loss liquids, capable of resolving the permittivity of water.


Optimal Streaming Algorithms for Submodular Maximization with Cardinality Constraints. We study the problem of maximizing a non monotone submodular function subject to a cardinality constraint in the streaming model. Our main contribution is a single pass (semi )streaming algorithm that uses roughly O(k varepsilon 2) memory, where k is the size constraint. At the end of the stream, our algorithm post processes its data structure using any offline algorithm for submodular maximization, and obtains a solution whose approximation guarantee is frac alpha 1 alpha varepsilon , where alpha is the approximation of the offline algorithm. If we use an exact (exponential time) post processing algorithm, this leads to frac 1 2 varepsilon approximation (which is nearly optimal). If we post process with the algorithm of Buchbinder and Feldman (Math of OR 2019), that achieves the state of the art offline approximation guarantee of alpha 0.385 , we obtain 0.2779 approximation in polynomial time, improving over the previously best polynomial time approximation of 0.1715 due to Feldman et al. (NeurIPS 2018). It is also worth mentioning that our algorithm is combinatorial and deterministic, which is rare for an algorithm for non monotone submodular maximization, and enjoys a fast update time of O( frac log k log (1 alpha) varepsilon 2 ) per element.


Stratification and duality for unipotent finite supergroup schemes. We survey some methods developed in a series of papers, for classifying localising subcategories of tensor triangulated categories. We illustrate these methods by proving a new theorem, providing such a classification in the case of the stable module category of a unipotent finite supergroup scheme.


Conformer Kernel with Query Term Independence for Document Retrieval. The Transformer Kernel (TK) model has demonstrated strong reranking performance on the TREC Deep Learning benchmark and can be considered to be an efficient (but slightly less effective) alternative to BERT based ranking models. In this work, we extend the TK architecture to the full retrieval setting by incorporating the query term independence assumption. Furthermore, to reduce the memory complexity of the Transformer layers with respect to the input sequence length, we propose a new Conformer layer. We show that the Conformer's GPU memory requirement scales linearly with input sequence length, making it a more viable option when ranking long documents. Finally, we demonstrate that incorporating explicit term matching signal into the model can be particularly useful in the full retrieval setting. We present preliminary results from our work in this paper.


From Checking to Inference Actual Causality Computations as Optimization Problems. Actual causality is increasingly well understood. Recent formal approaches, proposed by Halpern and Pearl, have made this concept mature enough to be amenable to automated reasoning. Actual causality is especially vital for building accountable, explainable systems. Among other reasons, causality reasoning is computationally hard due to the requirements of counterfactuality and the minimality of causes. Previous approaches presented either inefficient or restricted, and domain specific, solutions to the problem of automating causality reasoning. In this paper, we present a novel approach to formulate different notions of causal reasoning, over binary acyclic models, as optimization problems, based on quantifiable notions within counterfactual computations. We contribute and compare two compact, non trivial, and sound integer linear programming (ILP) and Maximum Satisfiability (MaxSAT) encodings to check causality. Given a candidate cause, both approaches identify what a minimal cause is. Also, we present an ILP encoding to infer causality without requiring a candidate cause. We show that both notions are efficiently automated. Using models with more than 8000 variables, checking is computed in a matter of seconds, with MaxSAT outperforming ILP in many cases. In contrast, inference is computed in a matter of minutes.


J invariants for planar two center Stark Zeeman systems. In this paper, we introduce the notion of planar two center Stark Zeeman systems and define four J like invariants for their periodic orbits. The construction is based on a previous construction for planar one center Stark Zeeman system in Cieliebak Frauenfelder van Koert 2017 as well as Levi Civita and Birkhoff regularizations. We analyze the relationship among these invariants and show that they are largely independent, based on a new construction called interior connected sum.


GenScan A Generative Method for Populating Parametric 3D Scan Datasets. The availability of rich 3D datasets corresponding to the geometrical complexity of the built environments is considered an ongoing challenge for 3D deep learning methodologies. To address this challenge, we introduce GenScan, a generative system that populates synthetic 3D scan datasets in a parametric fashion. The system takes an existing captured 3D scan as an input and outputs alternative variations of the building layout including walls, doors, and furniture with corresponding textures. GenScan is a fully automated system that can also be manually controlled by a user through an assigned user interface. Our proposed system utilizes a combination of a hybrid deep neural network and a parametrizer module to extract and transform elements of a given 3D scan. GenScan takes advantage of style transfer techniques to generate new textures for the generated scenes. We believe our system would facilitate data augmentation to expand the currently limited 3D geometry datasets commonly used in 3D computer vision, generative design, and general 3D deep learning tasks.


Full Glow Fully conditional Glow for more realistic image generation. Autonomous agents, such as driverless cars, require large amounts of labeled visual data for their training. A viable approach for acquiring such data is training a generative model with collected real data, and then augmenting the collected real dataset with synthetic images from the model, generated with control of the scene layout and ground truth labeling. In this paper we propose Full Glow, a fully conditional Glow based architecture for generating plausible and realistic images of novel street scenes given a semantic segmentation map indicating the scene layout. Benchmark comparisons show our model to outperform recent works in terms of the semantic segmentation performance of a pretrained PSPNet. This indicates that images from our model are, to a higher degree than from other models, similar to real images of the same kinds of scenes and objects, making them suitable as training data for a visual semantic segmentation or object recognition system.


On the first bifurcation point for a free boundary problem modeling small arterial plaque. Atherosclerosis occurs when plaque clogs the arteries. It is a leading cause of death in the United States and worldwide. In this paper, we study the bifurcation for a highly nonlinear and highly coupled PDE model of plaque formation in the early stage of atherosclerosis. The model involves LDL and HDL cholesterols, macrophage cells as well as foam cells, with the interface separating the plaque and blood flow region being a free boundary. We establish the first bifurcation point for the system corresponding to n 1 mode. The symmetry breaking stationary solution studied in this paper might be helpful in understanding why there exists arterial plaque that is often accumulated more on one side of the artery than the other.


Utilizing Human Memory Processes to Model Genre Preferences for Personalized Music Recommendations. In this paper, we introduce a psychology inspired approach to model and predict the music genre preferences of different groups of users by utilizing human memory processes. These processes describe how humans access information units in their memory by considering the factors of (i) past usage frequency, (ii) past usage recency, and (iii) the current context. Using a publicly available dataset of more than a billion music listening records shared on the music streaming platform Last.fm, we find that our approach provides significantly better prediction accuracy results than various baseline algorithms for all evaluated user groups, i.e., (i) low mainstream music listeners, (ii) medium mainstream music listeners, and (iii) high mainstream music listeners. Furthermore, our approach is based on a simple psychological model, which contributes to the transparency and explainability of the calculated predictions.


A Simple Global Neural Discourse Parser. Discourse parsing is largely dominated by greedy parsers with manually designed features, while global parsing is rare due to its computational expense. In this paper, we propose a simple chart based neural discourse parser that does not require any manually crafted features and is based on learned span representations only. To overcome the computational challenge, we propose an independence assumption between the label assigned to a node in the tree and the splitting point that separates its children, which results in tractable decoding. We empirically demonstrate that our model achieves the best performance among global parsers, and comparable performance to state of art greedy parsers, using only learned span representations.


Transversely isotropic poroelastic behaviour of the Callovo Oxfordian claystone A set of stress dependent parameters. In the framework of a deep geological radioactive waste disposal in France, the hydromechanical properties of the designated host rock, the Callovo Oxfordian claystone (COx), are investigated in laboratory tests. Experiments presented in this study are carried out to determine several coefficients required within a transversely isotropic material model. They include isotropic compression tests, pore pressure tests, and deviatoric loading tests parallel and perpendicular to the bedding plane. We emphasize the adapted experimental devices and testing procedures, necessary to detect small strains under high pressures, on a material, which is sensitive to water and has a very low permeability. In particular, we discovered a significant decrease of elastic stiffness with decreasing effective stress, which was observed to be reversible. In both isotropic and deviatoric tests, a notable anisotropic strain response was found. The Young modulus parallel to bedding was about 1.8 times higher than the one perpendicular to the bedding plane. A notably low Poisson ratio perpendicular to the bedding plane with values between 0.1 and 0.2 was evidenced. While the anisotropy of the back calculated Biot coefficient was found to be low, a significant anisotropy of the Skempton coefficient was computed. The performed experiments provide an overdetermined set of material parameters at different stress levels. Using all determined parameters in a least square error regression scheme, seven independent elastic coefficients and their effective stress dependency are characterized. Parameters measured under isotropic loading are well represented by this set of coefficients, while the poroelastic framework with isotropic stress dependency is not sufficient to describe laboratory findings from triaxial loading.


Thermal null medium (TNM) a novel material to achieve feasible thermodynamics devices beyond conventional challenges. Recently, heat manipulation has gained the attention of scientific community due to its several applications. In this letter, based on transformation thermodynamic (TT) methodology, a novel material, which is called thermal null medium (TNM), is proposed that enables us to design various thermal functionalities such as thermal bending devices, arbitrary shape heat concentrators and omnidirectional thermal cloaks. In contrary to the conventional TT based conductivities, which are inhomogeneous and anisotropic, TNMs are homogeneous and easy to realize. In addition, the attained TNMs are independent of the device shape. That is if the geometry of the desired device is changed, there is no need to recalculate the necessitating conductivities. This feature of TNM will make it suitable for scenarios where re configurability is of utmost importance. Several numerical simulations are carried out to demonstrate the TNM capability and its applications in directional bending devices, heat concentrators and thermal cloaks. The proposed TNM could open a new avenue for potential applications in solar thermal panels and thermal electric devices.


Speckled cross spectral densities and their associated correlation singularities for a modern source of partially coherent x rays. We consider a realistic model for calculating the cross spectral density of partially coherent beams from an x ray undulator in a modern storage ring. This two point coherence function is seen to have a speckled structure associated with the presence of x ray coherence vortices and domain walls. Such cross spectral density speckle is associated with a network of spatial pairs of points for which there is zero correlation. X ray coherence vortices and domain walls are seen to emerge naturally as the number of coherent modes required increases. An understanding of the existence and nature of such correlation singularities enhances our ability to exploit partially coherent x ray radiation from new or upgraded synchrotron sources, for both imaging and diffraction applications.


Tree containment and degree conditions. We survey results and open problems relating degree conditions with tree containment in graphs, random graphs, digraphs and hypergraphs, and their applications in Ramsey theory.


On categories of o minimal structures. Our aim in this paper is to look at some transfer results in model theory (mainly in the context of o minimal structures) from the category theory viewpoint.


Improvement of Classification in One Stage Detector. RetinaNet proposed Focal Loss for classification task and improved one stage detectors greatly. However, there is still a gap between it and two stage detectors. We analyze the prediction of RetinaNet and find that the misalignment of classification and localization is the main factor. Most of predicted boxes, whose IoU with ground truth boxes are greater than 0.5, while their classification scores are lower than 0.5, which shows that the classification task still needs to be optimized. In this paper we proposed an object confidence task for this problem, and it shares features with classification task. This task uses IoUs between samples and ground truth boxes as targets, and it only uses losses of positive samples in training, which can increase loss weight of positive samples in classification task training. Also the joint of classification score and object confidence will be used to guide NMS. Our method can not only improve classification task, but also ease misalignment of classification and localization. To evaluate the effectiveness of this method, we show our experiments on MS COCO 2017 dataset. Without whistles and bells, our method can improve AP by 0.7 and 1.0 on COCO validation dataset with ResNet50 and ResNet101 respectively at same training configs, and it can achieve 38.4 AP with two times training time. Code is at http github.com chenzuge1 RetinaNet Conf.git.


Actor Critic Instance Segmentation. Most approaches to visual scene analysis have emphasised parallel processing of the image elements. However, one area in which the sequential nature of vision is apparent, is that of segmenting multiple, potentially similar and partially occluded objects in a scene. In this work, we revisit the recurrent formulation of this challenging problem in the context of reinforcement learning. Motivated by the limitations of the global max matching assignment of the ground truth segments to the recurrent states, we develop an actor critic approach in which the actor recurrently predicts one instance mask at a time and utilises the gradient from a concurrently trained critic network. We formulate the state, action, and the reward such as to let the critic model long term effects of the current prediction and incorporate this information into the gradient signal. Furthermore, to enable effective exploration in the inherently high dimensional action space of instance masks, we learn a compact representation using a conditional variational auto encoder. We show that our actor critic model consistently provides accuracy benefits over the recurrent baseline on standard instance segmentation benchmarks.


Physics informed Gaussian Process for Online Optimization of Particle Accelerators. High dimensional optimization is a critical challenge for operating large scale scientific facilities. We apply a physics informed Gaussian process (GP) optimizer to tune a complex system by conducting efficient global search. Typical GP models learn from past observations to make predictions, but this reduces their applicability to new systems where archive data is not available. Instead, here we use a fast approximate model from physics simulations to design the GP model. The GP is then employed to make inferences from sequential online observations in order to optimize the system. Simulation and experimental studies were carried out to demonstrate the method for online control of a storage ring. We show that the physics informed GP outperforms current routinely used online optimizers in terms of convergence speed, and robustness on this task. The ability to inform the machine learning model with physics may have wide applications in science.


Semi Supervised Spoken Language Understanding via Self Supervised Speech and Language Model Pretraining. Much recent work on Spoken Language Understanding (SLU) is limited in at least one of three ways models were trained on oracle text input and neglected ASR errors, models were trained to predict only intents without the slot values, or models were trained on a large amount of in house data. In this paper, we propose a clean and general framework to learn semantics directly from speech with semi supervision from transcribed or untranscribed speech to address these issues. Our framework is built upon pretrained end to end (E2E) ASR and self supervised language models, such as BERT, and fine tuned on a limited amount of target SLU data. We study two semi supervised settings for the ASR component supervised pretraining on transcribed speech, and unsupervised pretraining by replacing the ASR encoder with self supervised speech representations, such as wav2vec. In parallel, we identify two essential criteria for evaluating SLU models environmental noise robustness and E2E semantics evaluation. Experiments on ATIS show that our SLU framework with speech as input can perform on par with those using oracle text as input in semantics understanding, even though environmental noise is present and a limited amount of labeled semantics data is available for training.


On a solution to the Monge transport problem on the real line arising from the strictly concave case. It is well known that the optimal transport problem on the real line for the classical distance cost may not have a unique solution. In this paper we recover uniqueness by considering the transport problems where the costs are a power smaller than one of the distance, and letting this parameter tend to one. A complete construction of this solution that we call excursion coupling is given. This is reminiscent to the one in the convex case. It is also characterized as the solution of secondary transport problems. Moreover, a combinatoric geometric characterization of the routes used for this transport plan is provided.


Hierarchical Graph Matching Network for Graph Similarity Computation. Graph edit distance similarity is widely used in many tasks, such as graph similarity search, binary function analysis, and graph clustering. However, computing the exact graph edit distance (GED) or maximum common subgraph (MCS) between two graphs is known to be NP hard. In this paper, we propose the hierarchical graph matching network (HGMN), which learns to compute graph similarity from data. HGMN is motivated by the observation that two similar graphs should also be similar when they are compressed into more compact graphs. HGMN utilizes multiple stages of hierarchical clustering to organize a graph into successively more compact graphs. At each stage, the earth mover distance (EMD) is adopted to obtain a one to one mapping between the nodes in two graphs (on which graph similarity is to be computed), and a correlation matrix is also derived from the embeddings of the nodes in the two graphs. The correlation matrices from all stages are used as input for a convolutional neural network (CNN), which is trained to predict graph similarity by minimizing the mean squared error (MSE). Experimental evaluation on 4 datasets in different domains and 4 performance metrics shows that HGMN consistently outperforms existing baselines in the accuracy of graph similarity approximation.


An instantaneous market volatility estimation. Working on different aspects of algorithmic trading we empirically discovered a new market invariant. It links together the volatility of the instrument with its traded volume, the average spread and the volume in the order book. The invariant has been tested on different markets and different asset classes. In all cases we did not find significant violation of the invariant. The formula for the invariant was used for the volatility estimation, which we called the instantaneous volatility. Quantitative comparison showed that it reproduces realised volatility better than one day ahead GARCH(1,1) prediction. Because of the short term prediction nature, the instantaneous volatility could be used by algo developers, volatility traders and other market professionals.


Human centric Dialog Training via Offline Reinforcement Learning. How can we train a dialog model to produce better conversations by learning from human feedback, without the risk of humans teaching it harmful chat behaviors? We start by hosting models online, and gather human feedback from real time, open ended conversations, which we then use to train and improve the models using offline reinforcement learning (RL). We identify implicit conversational cues including language similarity, elicitation of laughter, sentiment, and more, which indicate positive human feedback, and embed these in multiple reward functions. A well known challenge is that learning an RL policy in an offline setting usually fails due to the lack of ability to explore and the tendency to make over optimistic estimates of future reward. These problems become even harder when using RL for language models, which can easily have a 20,000 action vocabulary and many possible reward functions. We solve the challenge by developing a novel class of offline RL algorithms. These algorithms use KL control to penalize divergence from a pre trained prior language model, and use a new strategy to make the algorithm pessimistic, instead of optimistic, in the face of uncertainty. We test the resulting dialog model with ratings from 80 users in an open domain setting and find it achieves significant improvements over existing deep offline RL approaches. The novel offline RL method is viable for improving any existing generative dialog model using a static dataset of human feedback.


adPerf Characterizing the Performance of Third party Ads. Monetizing websites and web apps through online advertising is widespread in the web ecosystem. The online advertising ecosystem nowadays forces publishers to integrate ads from these third party domains. On the one hand, this raises several privacy and security concerns that are actively studied in recent years. On the other hand, given the ability of today's browsers to load dynamic web pages with complex animations and Javascript, online advertising has also transformed and can have a significant impact on webpage performance. The performance cost of online ads is critical since it eventually impacts user satisfaction as well as their Internet bill and device energy consumption. In this paper, we apply an in depth and first of a kind performance evaluation of web ads. Unlike prior efforts that rely primarily on adblockers, we perform a fine grained analysis on the web browser's page loading process to demystify the performance cost of web ads. We aim to characterize the cost by every component of an ad, so the publisher, ad syndicate, and advertiser can improve the ad's performance with detailed guidance. For this purpose, we develop an infrastructure, adPerf, for the Chrome browser that classifies page loading workloads into ad related and main content at the granularity of browser activities (such as Javascript and Layout). Our evaluations show that online advertising entails more than 15 of browser page loading workload and approximately 88 of that is spent on JavaScript. We also track the sources and delivery chain of web ads and analyze performance considering the origin of the ad contents. We observe that 2 of the well known third party ad domains contribute to 35 of the ads performance cost and surprisingly, top news websites implicitly include unknown third party ads which in some cases build up to more than 37 of the ads performance cost.


A pathological case of the C 1 conjecture in mixed characteristic. Let K be a field of characteristic 0. Fix integers r,d coprime with r geq 2 . Let X K be a smooth, projective, geometrically connected curve of genus g geq 2 defined over K. Assume there exists a line bundle L K on X K of degree d . In this article we prove the existence of a stable locally free sheaf on X K with rank r and determinant L K . This trivially proves the C 1 conjecture in mixed characteristic for the moduli space of stable locally free sheaves of fixed rank and determinant over a smooth, projective curve.


Fractional Brownian Motions and their multifractal analysis applied to Parana river flow. A number of different analysis techniques have been used to analyze long term time series data from different rivers, starting with the determination of the Hurst coefficient. We summarize the concept of fractals, multifractals and Fractional Brownian Motion (FBM), and apply some such techniques to daily stream flow data from the Parana River recorded at Corrientes, Argentina, for 106 years. After determining the Hurst coefficient for the entire data set (H 0.76), we analyze the data for each of four seasons and draw the corresponding FBM graphs and their multifractal spectra (MFS). Three of the seasons are similar, but autumn is very different for both FBM and MFS. Based on the MFS results, we propose a number of indices for measuring variations in stream flow, and determine the values of the indices for the three similar seasons. The indices are based on important parameters of the multifractal spectra. The geometry of the spectra as well as the indices all indicate that Winter is the most stable season. This is in contrast to the Boxplot of seasonal stream flow data where Winter shows the largest variation. Thus, these indices provide insight into river flow stability, not detected in, and indeed contradictory to, that from basic statistical analysis.


On stability of small solitons of the 1 D NLS with a trapping delta potential. We consider a Nonlinear Schr "odinger Equation with a very general non linear term and with a trapping delta potential on the line. We then discuss the asymptotic behavior of all its small solutions, generalizing a recent result by Masaki et al. We give also a result of dispersion in the case of defocusing equations with a non trapping delta potential.


NEU at WNUT 2020 Task 2 Data Augmentation To Tell BERT That Death Is Not Necessarily Informative. Millions of people around the world are sharing COVID 19 related information on social media platforms. Since not all the information shared on the social media is useful, a machine learning system to identify informative posts can help users in finding relevant information. In this paper, we present a BERT classifier system for W NUT2020 Shared Task 2 Identification of Informative COVID 19 English Tweets. Further, we show that BERT exploits some easy signals to identify informative tweets, and adding simple patterns to uninformative tweets drastically degrades BERT performance. In particular, simply adding 10 deaths to tweets in dev set, reduces BERT F1 score from 92.63 to 7.28. We also propose a simple data augmentation technique that helps in improving the robustness and generalization ability of the BERT classifier.


On Non Interactive Simulation of Binary Random Variables. We leverage proof techniques Fourier analysis and an existing result in coding theory to derive new bounds for the problem of non interactive simulation of binary random variables. Previous bounds in the literature were derived by applying data processing inequalities concerning maximal correlation or hypercontractivity. We show that our bounds are sharp in some regimes. For a specific instance of problem parameters, our main result answers an open problem posed by E. Mossel in 2017. As by products of our analyses, various new properties of the average distance and distance enumerator of binary block codes are established.


Interlayer link prediction in multiplex social networks an iterative degree penalty algorithm. Online social network (OSN) applications provide different experiences for example, posting a short text on Twitter and sharing photographs on Instagram. Multiple OSNs constitute a multiplex network. For privacy protection and usage purposes, accounts belonging to the same user in different OSNs may have different usernames, photographs, and introductions. Interlayer link prediction in multiplex network aims at identifying whether the accounts in different OSNs belong to the same person, which can aid in tasks including cybercriminal behavior modeling and customer interest analysis. Many real world OSNs exhibit a scale free degree distribution thus, neighbors with different degrees may exert different influences on the node matching degrees across different OSNs. We developed an iterative degree penalty (IDP) algorithm for interlayer link prediction in the multiplex network. First, we proposed a degree penalty principle that assigns a greater weight to a common matched neighbor with fewer connections. Second, we applied node adjacency matrix multiplication for efficiently obtaining the matching degree of all unmatched node pairs. Thereafter, we used the approved maximum value method to obtain the interlayer link prediction results from the matching degree matrix. Finally, the prediction results were inserted into the priori interlayer node pair set and the above processes were performed iteratively until all unmatched nodes in one layer were matched or all matching degrees of the unmatched node pairs were equal to 0. Experiments demonstrated that our advanced IDP algorithm significantly outperforms current network structure based methods when the multiplex network average degree and node overlapping rate are low.


The Counterfactual NESS Definition of Causation. In previous work with Joost Vennekens I proposed a definition of actual causation that is based on certain plausible principles, thereby allowing the debate on causation to shift away from its heavy focus on examples towards a more systematic analysis. This paper contributes to that analysis in two ways. First, I show that our definition is in fact a formalization of Wright's famous NESS definition of causation combined with a counterfactual difference making condition. This means that our definition integrates two highly influential approaches to causation that are claimed to stand in opposition to each other. Second, I modify our definition to offer a substantial improvement I weaken the difference making condition in such a way that it avoids the problematic analysis of cases of preemption. The resulting Counterfactual NESS definition of causation forms a natural compromise between counterfactual approaches and the NESS approach.


Delta weakly mixing subsets along a collection of sequences of integers. In this paper, we propose a mild condition, named Condition ( ) , for collections of sequence of integers and show that for any measure preserving system the Pinsker sigma algebra is a characteristic sigma algebra for the averages along a collection satisfying Condition ( ) . We introduce the notion of Delta weakly mixing subsets along a collection of sequences of integers and show that positive topological entropy implies the existence of Delta weakly mixing subsets along a collection of "good" sequences. As a consequence, we show that positive topological entropy implies multi variant Li Yorke chaos along polynomial times of the shift prime numbers.


New mixed recurrence relations of two variable orthogonal polynomials via differential operators. In this paper, we derive new recurrence relations for two variable orthogonal polynomials for example Jacobi polynomial, Bateman's polynomial and Legendre polynomial via two different differential operators Xi left( frac partial partial z sqrt w frac partial partial w right) and Delta left( frac 1 w frac partial partial z frac 1 z frac partial partial w right) . We also derive some special cases of our main results.


Facilitating SQL Query Composition and Analysis. Formulating efficient SQL queries requires several cycles of tuning and execution, particularly for inexperienced users. We examine methods that can accelerate and improve this interaction by providing insights about SQL queries prior to execution. We achieve this by predicting properties such as the query answer size, its run time, and error class. Unlike existing approaches, our approach does not rely on any statistics from the database instance or query execution plans. This is particularly important in settings with limited access to the database instance. Our approach is based on using data driven machine learning techniques that rely on large query workloads to model SQL queries and their properties. We evaluate the utility of neural network models and traditional machine learning models. We use two real world query workloads the Sloan Digital Sky Survey (SDSS) and the SQLShare query workload. Empirical results show that the neural network models are more accurate in predicting the query error class, achieving a higher F measure on classes with fewer samples as well as performing better on other problems such as run time and answer size prediction. These results are encouraging and confirm that SQL query workloads and data driven machine learning methods can be leveraged to facilitate query composition and analysis.


The S n equivariant top weight Euler characteristic of M g,n . We prove a formula, conjectured by Zagier, for the S n equivariant Euler characteristic of the top weight cohomology of M g,n .


Truncation in Besov Morrey and Triebel Lizorkin Morrey spaces. We will prove that under certain conditions on the parameters the operators T f max(f,0) and Tf f are bounded mappings on the Triebel Lizorkin Morrey and Besov Morrey spaces. Moreover we will show that some of the conditions we mentioned before are also necessary. Furthermore we prove that for p u in many cases the Triebel Lizorkin Morrey spaces do not have the Fubini property.


On one approach to modeling numeral systems. In this article, the operator approach to modeling numeral systems is introduced. This approach can be useful for coding information and providing computer protection. Certain examples of such numeral systems are considered. In addition, the pseudo binary representation is investigated. A description of further investigations of the author of this article is given.


Redesigning Telecommunication Engineering Courses with CDIO geared for Polytechnic Education. Whether in chemical, civil, mechanical, electrical, or their related engineering subdisciplines, remaining up to date in the subject matter is crucial. However, due to the pace of technological evolution, information and communications technology (ICT) fields of study are impacted with much higher consequences. Meanwhile, the curricula of higher educational institutes are struggling to catch up to this reality. In order to remain competitive, engineering schools ought to offer ICT related courses that are at once modern, relevant and ultimately beneficial for the employability of their graduates. In this spirit, we were recently mandated by our engineering school to develop and design telecommunication courses with great emphasis on (i) technological modernity, and (ii) experiential learning. To accomplish these objectives, we utilized the conceive, design, implement and operate (CDIO) framework, a modern engineering education initiative of which Sheridan is a member. In this article, we chronicle the steps we took to streamline and modernize the curriculum by outlining an effective methodology for course design and development with CDIO. We then provide examples of course update and design using the proposed methodology and highlight the lessons learned from this systematic curriculum development endeavor.


Combining Parameter Identification and Trajectory Optimization Real time Planning for Information Gain. Robotic systems often operate with uncertainties in their dynamics, for example, unknown inertial properties. Broadly, there are two approaches for controlling uncertain systems design robust controllers in spite of uncertainty, or characterize a system before attempting to control it. This paper proposes a middle ground approach, making trajectory progress while also accounting for gaining information about the system. More specifically, it combines excitation trajectories which are usually intended to optimize information gain for an estimator, with goal driven trajectory optimization metrics. For this purpose, a measure of information gain is incorporated (using the Fisher Information Matrix) in a real time planning framework to produce trajectories favorable for estimation. At the same time, the planner receives stable parameter updates from the estimator, enhancing the system model. An implementation of this learn as you go approach utilizing an Unscented Kalman Filter (UKF) and Nonlinear Model Predictive Controller (NMPC) is demonstrated in simulation. Results for cases with and without information gain and online parameter updates in the system model are presented.


The collaboration behavior of top scientists. The intention of this work is to analyze top scientists' collaboration behavior at the "international", "domestic extramural" and "intramural" levels, and compare it to that of their lesser performing colleagues. The field of observation consists of the entire faculty of the Italian academic system, and so the coauthorship of scientific publications by over 12,000 professors. The broader aim is to improve understanding of the causal nexus between research collaboration and performance. The analysis is thus longitudinal, over two successive five year periods. Results show a strong increase in the propensity to collaborate at domestic level (both extramural and intramural), however this is less for scientists who remain or become top, than it is for their lower performing colleagues. In contrast, the increase in international collaboration behavior is greater for scientists who become or remain top than it is for their peers. The increase in productivity by those who acquire top scientist status is due precisely to the greater average impact of the publications achieved in collaboration with foreign colleagues.


Performance Comparison Between OpenCV Built in CPU and GPU Functions on Image Processing Operations. Image Processing is a specialized area of Digital Signal Processing which contains various mathematical and algebraic operations such as matrix inversion, transpose of matrix, derivative, convolution, Fourier Transform etc. Operations like those require higher computational capabilities than daily usage purposes of computers. At that point, with increased image sizes and more complex operations, CPUs may be unsatisfactory since they use Serial Processing by default. GPUs are the solution that come up with greater speed compared to CPUs because of their Parallel Processing Computation nature. A parallel computing platform and programming model named CUDA was created by NVIDIA and implemented by the graphics processing units (GPUs) which were produced by them. In this paper, computing performance of some commonly used Image Processing operations will be compared on OpenCV's built in CPU and GPU functions that use CUDA.


Learning to Inpaint by Progressively Growing the Mask Regions. Image inpainting is one of the most challenging tasks in computer vision. Recently, generative based image inpainting methods have been shown to produce visually plausible images. However, they still have difficulties to generate the correct structures and colors as the masked region grows large. This drawback is due to the training stability issue of the generative models. This work introduces a new curriculum style training approach in the context of image inpainting. The proposed method increases the masked region size progressively in training time, during test time the user gives variable size and multiple holes at arbitrary locations. Incorporating such an approach in GANs may stabilize the training and provides better color consistencies and captures object continuities. We validate our approach on the MSCOCO and CelebA datasets. We report qualitative and quantitative comparisons of our training approach in different models.


Continuity between Cauchy and Bolzano Issues of antecedents and priority. In a paper published in 1970, Grattan Guinness argued that Cauchy, in his 1821 book Cours d'Analyse, may have plagiarized Bolzano's book Rein analytischer Beweis (RB), first published in 1817. That paper was subsequently discredited in several works, but some of its assumptions still prevail today. In particular, it is usually considered that Cauchy did not develop his notion of the continuity of a function before Bolzano developed his in RB, and that both notions are essentially the same. We argue that both assumptions are incorrect, and that it is implausible that Cauchy's initial insight into that notion, which eventually evolved to an approach using infinitesimals, could have been borrowed from Bolzano's work. Furthermore, we account for Bolzano's interest in that notion and focus on his discussion of a definition by K "astner (in Section 183 of his 1766 book), which the former seems to have misrepresented at least partially. Cauchy's treatment of continuity goes back at least to his 1817 course summaries, refuting a key component of Grattan Guinness' plagiarism hypothesis (that Cauchy may have lifted continuity from RB after reading it in a Paris library in 1818). We explore antecedents of Cauchy and Bolzano continuity in the writings of K "astner and earlier authors.


Alleviating Over segmentation Errors by Detecting Action Boundaries. We propose an effective framework for the temporal action segmentation task, namely an Action Segment Refinement Framework (ASRF). Our model architecture consists of a long term feature extractor and two branches the Action Segmentation Branch (ASB) and the Boundary Regression Branch (BRB). The long term feature extractor provides shared features for the two branches with a wide temporal receptive field. The ASB classifies video frames with action classes, while the BRB regresses the action boundary probabilities. The action boundaries predicted by the BRB refine the output from the ASB, which results in a significant performance improvement. Our contributions are three fold (i) We propose a framework for temporal action segmentation, the ASRF, which divides temporal action segmentation into frame wise action classification and action boundary regression. Our framework refines frame level hypotheses of action classes using predicted action boundaries. (ii) We propose a loss function for smoothing the transition of action probabilities, and analyze combinations of various loss functions for temporal action segmentation. (iii) Our framework outperforms state of the art methods on three challenging datasets, offering an improvement of up to 13.7 in terms of segmental edit distance and up to 16.1 in terms of segmental F1 score. Our code will be publicly available soon.


Local recovery bounds for prior support constrained Compressed Sensing. Prior support constrained compressed sensing has of late become popular due to its potential for applications. The existing results on recovery guarantees provide global recovery bounds in the sense that they deal with full support. However, in some applications, one might be interested in the recovery guarantees limited to the given prior support, such bounds may be termed as local recovery bounds. The present work proposes the local recovery guarantees and analyzes the conditions on associated parameters that make recovery error small.


Comparative Study of RF Sputtered Ba2(BiNb)O6 and Ba2Bi1.4Nb0.6 O6 thin films and Effect of Fluorine Doping in Their Photoelectrochemical (PEC) Performances. Bismuth based ternary oxide photocatalysts are of considerable interest in photoelectrochemical water splitting. Yet these oxides are highly stable in different environment, their relative inertness limits the available synthesis routes to obtain desired stoichiometry on the final product. This report describes a method to prepare barium bismuth niobate (specifically, Ba2(BiNb)O6 and Ba2Bi1.4Nb0.6 O6) target by sintering a mixture of individual oxides and successfully fabricate desired barium bismuth niobate thin film on TCO substrate. The surface morphology, physical, and chemical properties of thin film were systematically investigated. Compositional uniformity was obtained by sputtering in oxygen argon plasma environment and higher photocatalytic activities were observed after subsequent surface treatments. Sodium fluoride surface treatment further enhanced the photocurrent density and improved electrode stability against corrosion. This work further suggests a viable approach to improve the PEC performance of sputtered barium bismuth niobate by modulating their fundamental energy states.


On the Performance of the Spatial Reuse Operation in IEEE 802.11ax WLANs. The Spatial Reuse (SR) operation included in the IEEE 802.11ax 2020 (11ax) amendment aims at increasing the number of parallel transmissions in an Overlapping Basic Service Set (OBSS). However, many unknowns exist about the performance gains that can be achieved through SR. In this paper, we provide a brief introduction to the SR operation described in the IEEE 802.11ax (draft D4.0). Then, a simulation based implementation is provided in order to explore the performance gains of the SR operation. Our results show the potential of using SR in different scenarios covering multiple network densities and traffic loads. In particular, we observe significant improvements on the channel utilization when applying SR with respect to the default configuration, thus allowing to increase the throughput and reduce the delay. Interestingly, the highest improvements provided by the SR operation are observed in the most pessimistic situations in terms of network density and traffic load.


Regularity for minimizers for functionals of double phase with variable exponents. The functionals of double phase type mathcal H (u) int left( Du p a(x) Du q right) dx, ( q p 1, a(x) geq 0) are introduced in the epoch making paper by Colombo Mingione for constants p and q , and investigated by them and Baroni. They obtained sharp regularity results for minimizers of such functionals. In this paper we treat the case that the exponents are functions of x and partly generalize their regularity results.