Progressive Cleaning and Mining of Uncertain Smart Water Meter Data. Several municipalities have recently installed wireless 'smart' water meters that allow functionalities such as demand response, leak alerts, identification of characteristic demand patterns, and detailed consumption analysis. To achieve these benefits, the meter data needs to be error free, which is not necessarily available in practice, due to 'dirtiness' or 'uncertainty' of data, which is mostly unavoidable. The focus of this paper is to investigate practical solutions to mine uncertain data for reliable results and to evaluate the impact of dirty data on filters. This evaluation would eventually lead to valuable information, which can be used for educated decision making on water planning strategies. We perform a systematic study of the errors existing in a large scale smart water meter deployments, which is helpful to better understand the nature of errors. Identifying customers contributing to a load peak is used as the main filter. The filter outputs are then combined with the domain expert knowledge to evaluate their accuracy and validity and also to look for potential errors. After discovering each error, we analyze its trails in the data and track back its source, which would eventually lead to the removal of the error or dealing with it accordingly. This procedure is applied progressively to ensure that all detectable errors are discovered and characterized in the data model. We evaluate the performance of the proposed approach using the smart water meter consumption data obtained from the City of Abbotsford, British Columbia, Canada. We present the results of both unprocessed and cleaned data and analyze, in detail, the sensitivity of the selected filter to the errors.


Sampling and Learning for Boolean Function. In this article, we continue our study on universal learning machine by introducing new tools. We first discuss boolean function and boolean circuit, and we establish one set of tools, namely, fitting extremum and proper sampling set. We proved the fundamental relationship between proper sampling set and complexity of boolean circuit. Armed with this set of tools, we then introduce much more effective learning strategies. We show that with such learning strategies and learning dynamics, universal learning can be achieved, and requires much less data.


Dealing with uncertainty in agent based models for short term predictions. Agent based models (ABM) are gaining traction as one of the most powerful modelling tools within the social sciences. They are particularly suited to simulating complex systems. Despite many methodological advances within ABM, one of the major drawbacks is their inability to incorporate real time data to make accurate short term predictions. This paper presents an approach that allows ABMs to be dynamically optimised. Through a combination of parameter calibration and data assimilation (DA), the accuracy of model based predictions using ABM in real time is increased. We use the exemplar of a bus route system to explore these methods. The bus route ABMs developed in this research are examples of ABMs that can be dynamically optimised by a combination of parameter calibration and DA. The proposed model and framework can also be used in an passenger information system, or in an Intelligent Transport Systems to provide forecasts of bus locations and arrival times.


math.NA cs.NA physics.geo-ph physics.med-ph

Inbetweening auto animation via Fokker Planck dynamics and thresholding. We propose an equilibrium driven deformation algorithm (EDDA) to simulate the inbetweening transformations starting from an initial image to an equilibrium image, which covers images varying from a greyscale type to a colorful type on plane or manifold. The algorithm is based on Fokker Planck dynamics on manifold, which automatically cooperates positivity, unconditional stability, mass conservation law, exponentially convergence and also the manifold structure suggested by dataset. The thresholding scheme is adapted for the sharp interface dynamics and is used to achieve the finite time convergence. Using EDDA, three challenging examples, (I) facial aging process, (II) coronavirus disease 2019 (COVID 19) invading treatment process, and (III) continental evolution process are conducted efficiently.


Sequences in Dihedral Groups with Distinct Partial Products. Given a subset S of the non identity elements of the dihedral group of order 2m , is it possible to order the elements of S so that the partial products are distinct? This is equivalent to the sequenceability of the group when S 2m 1 and so it is known that the answer is yes in this case if and only if m 4 . We show that the answer is yes when S leq 9 and m is an odd prime other than 3, when S 2m 2 and m is even or prime, and when S 2m 2 for many instances of the problem when m is odd and composite. We also consider the problem in the more general setting of arbitrary non abelian groups and discuss connections between this work and the concept of strong sequenceability.


L p theory for Cauchy transform on the unit disk. Let mathbb D be the unit disk and varphi in L p( mathbb D , mathrm d A) , where 1 leq p leq infty . For z in mathbb D , the Cauchy transform on mathbb D , denote by mathcal P , is defined as follows mathcal P varphi (z) int mathbb D left( frac varphi(w) w z frac z overline varphi(w) 1 bar w z right) mathrm d A(w). The Beurling transform on mathbb D , denote by mathcal H , is now defined as the z derivative of mathcal P . In this paper, by using Hardy's type inequalities and Bessel functions, we show that mathcal P L 2 to L 2 alpha approx1.086 , where alpha is a solution to the equation 2J 0(2 alpha) alpha J 1(2 alpha) 0 , and J 0 , J 1 are Bessel functions. Moreover, for p 2 , by using Taylor expansion, Parseval's formula and hypergeometric functions, we also prove that mathcal P L p to L infty 2( Gamma(2 q) Gamma 2(2 frac q 2 )) 1 q , where q p (p 1) is the conjugate exponent of p , and Gamma is the Gamma function. Finally, applying the same techniques developed in this paper, we show that the Beurling transform mathcal H acts as an isometry of L 2( mathbb D , mathrm d A) .


TexturePose Supervising Human Mesh Estimation with Texture Consistency. This work addresses the problem of model based human pose estimation. Recent approaches have made significant progress towards regressing the parameters of parametric human body models directly from images. Because of the absence of images with 3D shape ground truth, relevant approaches rely on 2D annotations or sophisticated architecture designs. In this work, we advocate that there are more cues we can leverage, which are available for free in natural images, i.e., without getting more annotations, or modifying the network architecture. We propose a natural form of supervision, that capitalizes on the appearance constancy of a person among different frames (or viewpoints). This seemingly insignificant and often overlooked cue goes a long way for model based pose estimation. The parametric model we employ allows us to compute a texture map for each frame. Assuming that the texture of the person does not change dramatically between frames, we can apply a novel texture consistency loss, which enforces that each point in the texture map has the same texture value across all frames. Since the texture is transferred in this common texture map space, no camera motion computation is necessary, or even an assumption of smoothness among frames. This makes our proposed supervision applicable in a variety of settings, ranging from monocular video, to multi view images. We benchmark our approach against strong baselines that require the same or even more annotations that we do and we consistently outperform them. Simultaneously, we achieve state of the art results among model based pose estimation approaches in different benchmarks. The project website with videos, results, and code can be found at https seas.upenn.edu pavlakos projects texturepose.


Continuum limit of p Laplacian evolution problems on graphs L q graphons and sparse graphs. In this paper we study continuum limits of the discretized p Laplacian evolution problem on sparse graphs with homogeneous Neumann boundary conditions. This extends the results of 24 to a far more general class of kernels, possibly singular, and graph sequences whose limit are the so called L q graphons. More precisely, we derive a bound on the distance between two continuous in time trajectories defined by two different evolution systems (i.e. with different kernels, second member and initial data). Similarly, we provide a bound in the case that one of the trajectories is discrete in time and the other is continuous. In turn, these results lead us to establish error estimates of the full discretization of the p Laplacian problem on sparse random graphs. In particular, we provide rate of convergence of solutions for the discrete models to the solution of the continuous problem as the number of vertices grows.


Quantitative Verification of Neural Networks And its Security Applications. Neural networks are increasingly employed in safety critical domains. This has prompted interest in verifying or certifying logically encoded properties of neural networks. Prior work has largely focused on checking existential properties, wherein the goal is to check whether there exists any input that violates a given property of interest. However, neural network training is a stochastic process, and many questions arising in their analysis require probabilistic and quantitative reasoning, i.e., estimating how many inputs satisfy a given property. To this end, our paper proposes a novel and principled framework to quantitative verification of logical properties specified over neural networks. Our framework is the first to provide PAC style soundness guarantees, in that its quantitative estimates are within a controllable and bounded error from the true count. We instantiate our algorithmic framework by building a prototype tool called NPAQ that enables checking rich properties over binarized neural networks. We show how emerging security analyses can utilize our framework in 3 concrete point applications quantifying robustness to adversarial inputs, efficacy of trojan attacks, and fairness bias of given neural networks.


A Faster Parameterized Algorithm for Temporal Matching. A temporal graph is a sequence of graphs (called layers) over the same vertex set describing a graph topology which is subject to discrete changes over time. A Delta temporal matching M is a set of time edges (e,t) (an edge e paired up with a point in time t ) such that for all distinct time edges (e,t),(e',t') in M we have that e and e' do not share an endpoint, or the time labels t and t' are at least Delta time units apart. Mertzios et al. STACS '20 provided a 2 O( Delta nu) cdot mathcal G O(1) time algorithm to compute the maximum size of a Delta temporal matching in a temporal graph mathcal G , where mathcal G denotes the size of mathcal G , and nu is the Delta vertex cover number of mathcal G . The Delta vertex cover number is the minimum number nu such that the classical vertex cover number of the union of any Delta consecutive layers of the temporal graph is upper bounded by nu . We show an improved algorithm to compute a Delta temporal matching of maximum size with a running time of Delta O( nu) cdot mathcal G and hence provide an exponential speedup in terms of Delta .


Attention based Neural Bag of Features Learning for Sequence Data. In this paper, we propose 2D Attention (2DA), a generic attention formulation for sequence data, which acts as a complementary computation block that can detect and focus on relevant sources of information for the given learning objective. The proposed attention module is incorporated into the recently proposed Neural Bag of Feature (NBoF) model to enhance its learning capacity. Since 2DA acts as a plug in layer, injecting it into different computation stages of the NBoF model results in different 2DA NBoF architectures, each of which possesses a unique interpretation. We conducted extensive experiments in financial forecasting, audio analysis as well as medical diagnosis problems to benchmark the proposed formulations in comparison with existing methods, including the widely used Gated Recurrent Units. Our empirical analysis shows that the proposed attention formulations can not only improve performances of NBoF models but also make them resilient to noisy data.


An isoperimetric problem with a competing nonlocal singular term. In this paper, we investigate the minimization of a functional in which the usual perimeter is competing with a nonlocal singular term comparable (but not necessarily equal to) a fractional perimeter. The motivation for this problem is a cell motility model introduced in some previous work by the first author. We establish several facts about global minimizers with a volume constraint. In particular we prove that minimizers exist and are radially symmetric for small mass, while minimizers cannot be radially symmetric for large mass. For large mass, we prove that the minimizing sequences either split into smaller sets that drift to infinity or develop fingers of a prescribed width. Finally, we connect these two alternatives to a related minimization problem for the optimal constant in a classical interpolation inequality (a Gagliardo Nirenberg type inequality for fractional perimeter).


Loss rates for high n , 49 lesssim n lesssim150 , 5sns( 3 S 1 ) Rydberg atoms excited in an 84 Sr Bose Einstein condensate. Measurements of the loss rates for strontium n 3 S 1 Rydberg atoms excited in a dense BEC are presented for values of principal quantum number n in the range 49 lesssim n lesssim 150 and local atom densities of sim1 to 3 times10 14 cm 3 . Two main processes contribute to loss, associative ionization and state changing. The relative importance of these two loss channels is investigated and their n and density dependences are discussed using a model in which Rydberg atom loss is presumed to involve a close collision between the Rydberg core ion and ground state atoms. The present measurements are compared to earlier results obtained using rubidium Rydberg atoms. For both species the observed loss rates are sizable, sim10 5 10 6 s 1 , and limit the time scales over which measurements involving Rydberg atoms immersed in quantum degenerate gases can be conducted.


An Empirical Investigation Towards Efficient Multi Domain Language Model Pre training. Pre training large language models has become a standard in the natural language processing community. Such models are pre trained on generic data (e.g. BookCorpus and English Wikipedia) and often fine tuned on tasks in the same domain. However, in order to achieve state of the art performance on out of domain tasks such as clinical named entity recognition and relation extraction, additional in domain pre training is required. In practice, staged multi domain pre training presents performance deterioration in the form of catastrophic forgetting (CF) when evaluated on a generic benchmark such as GLUE. In this paper we conduct an empirical investigation into known methods to mitigate CF. We find that elastic weight consolidation provides best overall scores yielding only a 0.33 drop in performance across seven generic tasks while remaining competitive in bio medical tasks. Furthermore, we explore gradient and latent clustering based data selection techniques to improve coverage when using elastic weight consolidation and experience replay methods.


Efficient Design of Subblock Energy Constrained Codes and Sliding Window Constrained Codes. The subblock energy constrained codes (SECCs) and sliding window constrained codes (SWCCs) have recently attracted attention due to various applications in communcation systems such as simultaneous energy and information transfer. In a SECC, each codewod is divided into smaller non overlapping windows, called subblocks, and every subblock is constrained to carry sufficient energy. In a SWCC, the energy constraint is enforced over every window. In this work, we focus on the binary channel, where sufficient energy is achieved theoretically by using relatively high weight codes, and study SECCs and SWCCs under more general constraints, namely bounded SECCs and bounded SWCCs. We propose two methods to construct such codes with low redundancy and linear time complexity, based on Knuth's balancing technique and sequence replacement technique. For certain codes parameters, our methods incur only one redundant bit. We also impose the minimum distance constraint for error correction capability of the designed codes, which helps to reduce the error propagation during decoding as well.


Position paper A systematic framework for categorising IoT device fingerprinting mechanisms. The popularity of the Internet of Things (IoT) devices makes it increasingly important to be able to fingerprint them, for example in order to detect if there are misbehaving or even malicious IoT devices in one's network. The aim of this paper is to provide a systematic categorisation of machine learning augmented techniques that can be used for fingerprinting IoT devices. This can serve as a baseline for comparing various IoT fingerprinting mechanisms, so that network administrators can choose one or more mechanisms that are appropriate for monitoring and maintaining their network. We carried out an extensive literature review of existing papers on fingerprinting IoT devices paying close attention to those with machine learning features. This is followed by an extraction of important and comparable features among the mechanisms outlined in those papers. As a result, we came up with a key set of terminologies that are relevant both in the fingerprinting context and in the IoT domain. This enabled us to construct a framework called IDWork, which can be used for categorising existing IoT fingerprinting mechanisms in a way that will facilitate a coherent and fair comparison of these mechanisms. We found that the majority of the IoT fingerprinting mechanisms take a passive approach mainly through network sniffing instead of being intrusive and interactive with the device of interest. Additionally, a significant number of the surveyed mechanisms employ both static and dynamic approaches, in order to benefit from complementary features that can be more robust against certain attacks such as spoofing and replay attacks.


Deep Network Ensemble Learning applied to Image Classification using CNN Trees. Traditional machine learning approaches may fail to perform satisfactorily when dealing with complex data. In this context, the importance of data mining evolves w.r.t. building an efficient knowledge discovery and mining framework. Ensemble learning is aimed at integration of fusion, modeling and mining of data into a unified model. However, traditional ensemble learning methods are complex and have optimization or tuning problems. In this paper, we propose a simple, sequential, efficient, ensemble learning approach using multiple deep networks. The deep network used in the ensembles is ResNet50. The model draws inspiration from binary decision classification trees. The proposed approach is compared against the baseline viz. the single classifier approach i.e. using a single multiclass ResNet50 on the ImageNet and Natural Images datasets. Our approach outperforms the baseline on all experiments on the ImageNet dataset. Code is available in https github.com mueedhafiz1982 CNNTreeEnsemble.git


Let's measure run time! Extending the IR replicability infrastructure to include performance aspects. Establishing a docker based replicability infrastructure offers the community a great opportunity measuring the run time of information retrieval systems. The time required to present query results to a user is paramount to the users satisfaction. Recent advances in neural IR re ranking models put the issue of query latency at the forefront. They bring a complex trade off between performance and effectiveness based on a myriad of factors the choice of encoding model, network architecture, hardware acceleration and many others. The best performing models (currently using the BERT transformer model) run orders of magnitude more slowly than simpler architectures. We aim to broaden the focus of the neural IR community to include performance considerations to sustain the practical applicability of our innovations. In this position paper we supply our argument with a case study exploring the performance of different neural re ranking models. Finally, we propose to extend the OSIRRC docker based replicability infrastructure with two performance focused benchmark scenarios.


Neuroevolution in Deep Neural Networks Current Trends and Future Challenges. A variety of methods have been applied to the architectural configuration and learning or training of artificial deep neural networks (DNN). These methods play a crucial role in the success or failure of the DNN for most problems and applications. Evolutionary Algorithms (EAs) are gaining momentum as a computationally feasible method for the automated optimisation and training of DNNs. Neuroevolution is a term which describes these processes of automated configuration and training of DNNs using EAs. While many works exist in the literature, no comprehensive surveys currently exist focusing exclusively on the strengths and limitations of using neuroevolution approaches in DNNs. Prolonged absence of such surveys can lead to a disjointed and fragmented field preventing DNNs researchers potentially adopting neuroevolutionary methods in their own research, resulting in lost opportunities for improving performance and wider application within real world deep learning problems. This paper presents a comprehensive survey, discussion and evaluation of the state of the art works on using EAs for architectural configuration and training of DNNs. Based on this survey, the paper highlights the most pertinent current issues and challenges in neuroevolution and identifies multiple promising future research directions.


math.PR cs.DM math.CO math.OC physics.data-an

The Pendulum Arrangement Maximizing the Escape Time of Heterogeneous Random Walks. We identify a fundamental phenomenon of heterogeneous one dimensional random walks the escape (traversal) time is maximized when the heterogeneity in transition probabilities forms a pyramid like potential barrier. This barrier corresponds to a distinct arrangement of transition probabilities, sometimes referred to as the pendulum arrangement. We reduce this problem to a sum over products, combinatorial optimization problem, proving that this unique structure always maximizes the escape time. This general property may influence studies in epidemiology, biology, and computer science to better understand escape time behavior and construct intruder resilient networks.


Automatic Spanish Translation of the SQuAD Dataset for Multilingual Question Answering. Recently, multilingual question answering became a crucial research topic, and it is receiving increased interest in the NLP community. However, the unavailability of large scale datasets makes it challenging to train multilingual QA systems with performance comparable to the English ones. In this work, we develop the Translate Align Retrieve (TAR) method to automatically translate the Stanford Question Answering Dataset (SQuAD) v1.1 to Spanish. We then used this dataset to train Spanish QA systems by fine tuning a Multilingual BERT model. Finally, we evaluated our QA models with the recently proposed MLQA and XQuAD benchmarks for cross lingual Extractive QA. Experimental results show that our models outperform the previous Multilingual BERT baselines achieving the new state of the art value of 68.1 F1 points on the Spanish MLQA corpus and 77.6 F1 and 61.8 Exact Match points on the Spanish XQuAD corpus. The resulting, synthetically generated SQuAD es v1.1 corpora, with almost 100 of data contained in the original English version, to the best of our knowledge, is the first large scale QA training resource for Spanish.


Escaping an Infinitude of Lions. We consider the following game played in the Euclidean plane There is any countable set of unit speed lions and one fast man who can run with speed 1 varepsilon for some value varepsilon 0 . Can the man survive? We answer the question in the affirmative for any varepsilon 0 .


Proof of the exact overlaps conjecture for systems with algebraic contractions. We establish the exact overlaps conjecture for iterated functions systems on the real line with algebraic contractions and arbitrary translations.


Random Matrices from Linear Codes and Wigner's Semicircle Law II. Recently we considered a class of random matrices obtained by choosing distinct codewords at random from linear codes over finite fields and proved that under some natural algebraic conditions their empirical spectral distribution converges to Wigner's semicircle law as the length of the codes goes to infinity. One of the conditions is that the dual distance of the codes is at least 5. In this paper, employing more advanced techniques related to Stieltjes transform, we show that the dual distance being at least 5 is sufficient to ensure the convergence, and the convergence rate is of the form n beta for some 0 beta 1 , where n is the length of the code.


Equivalence of conditions on initial data below the ground state to NLS with a repulsive inverse power potential. In this paper, we consider the nonlinear Schr "odinger equation with a repulsive inverse power potential. First, we show that some global well posedness results and "blow up or grow up" results below the ground state without the potential. Then, we prove equivalence of the conditions on the initial data below the ground state without potential. We note that recently, we established existence of a radial ground state and characterized it by the virial functional for NLS with a general potential in two or higher space dimensions in 8 . Then, we also prove a global well posedness result and a "blow up or grow up" result below the radial ground state with a repulsive inverse power potential obtained in 8 .


Dynamics of continuous time Markov chains with applications. This paper contributes an in depth study of properties of continuous time Markov chains (CTMCs) on non negative integer lattices N 0 d , with particular interest in one dimensional CTMCs with polynomial transitions rates. Such stochastic processes are abundant in applications, in particular in biology. We characterize the structure of the state space of general CTMCs on N 0 d in terms of the set of jump vectors and their corresponding transition rate functions. For CTMCs on N 0 with polynomial transition rate functions, we provide threshold criteria in terms of easily computable parameters for various dynamical properties such as explosivity, recurrence, transience, certain absorption, positive null recurrence, implosivity, and existence and non existence of moments of hitting times. In particular, simple sufficient conditions for exponential ergodicity of stationary distributions and quasi stationary distributions are obtained, and the few gap cases are well illustrated by examples. Subtle differences in conditions for different dynamical properties are revealed in terms of examples. Finally, we apply our results to stochastic reaction networks, an extended class of branching processes, a general bursty single cell stochastic gene expression model, and population processes which are not birth death processes.


Pattern Matching in Doubling Spaces. We consider the problem of matching a metric space (X,d X) of size k with a subspace of a metric space (Y,d Y) of size n geq k , assuming that these two spaces have constant doubling dimension delta . More precisely, given an input parameter rho geq 1 , the rho distortion problem is to find a one to one mapping from X to Y that distorts distances by a factor at most rho . We first show by a reduction from k clique that, in doubling dimension log 2 3 , this problem is NP hard and W 1 hard. Then we provide a near linear time approximation algorithm for fixed k Given an approximation ratio 0 varepsilon leq 1 , and a positive instance of the rho distortion problem, our algorithm returns a solution to the (1 varepsilon) rho distortion problem in time ( rho varepsilon) O(1) n log n . We also show how to extend these results to the minimum distortion problem in doubling spaces We prove the same hardness results, and for fixed k , we give a (1 varepsilon) approximation algorithm running in time ( dist (X,Y) varepsilon) O(1) n 2 log n , where dist (X,Y) denotes the minimum distortion between X and Y .


Scalable Consensus Protocols for PoW based Blockchain and blockDAG. In this paper, we propose two models for scaling the transaction throughput in Proof of Work (PoW) based blockchain networks. In the first approach, a mathematical model has derived for optimal transaction throughput for PoW based longest chain rule blockchain. In this approach, the blockchain Peer to Peer (P2P) network is considered as Erd "os R 'enyi random network topology. This approach is however limited by the block creation rate, the results suggest that the rate beyond an optimal point can result in unfairness in the system. The second approach is a new consensus protocol proposed by considering the ledger as a Directed Acyclic Graph (DAG) called blockDAG instead of a chain of blocks. In this framework, we follow a two step strategy that makes the system robust enough to handle the double spend attacks. The first step involves the development of an unsupervised learning graph clustering algorithm for separating the blocks created by an attacker. In the second step, the attackers blocks are eliminated and the remaining blocks are arranged in topological order by honest clients which makes the blockDAG system suitable for smart contract applications found in Internet of Things (IoT) services. The Simulation results demonstrate a significant improvement in the transaction throughput compared to bitcoin.


On the Parameterized Complexity Of Grid Contraction. For a family of graphs mathcal G , the mathcal G textsc Contraction problem takes as an input a graph G and an integer k , and the goal is to decide if there exists F subseteq E(G) of size at most k such that G F belongs to mathcal G . Here, G F is the graph obtained from G by contracting all the edges in F . In this article, we initiate the study of textsc Grid Contraction from the parameterized complexity point of view. We present a fixed parameter tractable algorithm, running in time c k cdot V(G) mathcal O (1) , for this problem. We complement this result by proving that unless ETH fails, there is no algorithm for textsc Grid Contraction with running time c o(k) cdot V(G) mathcal O (1) . We also present a polynomial kernel for this problem.


Generalized phase sensitivity of directional bond breaking in laser molecule interaction. We establish a generalized picture of the phase sensitivity of laser induced directional bond breaking using the H 2 molecule as the example. We show that the well known proton ejection anisotropy measured with few cycle pulses arises as an amplitude modulation of an intrinsic anisotropy that is sensitive to the laser phase at the ionization time and determined by the molecule's electronic structure. Our work furthermore reveals a strong electron proton correlation that may open up a new approach to experimentally accessing the laser sub cycle intramolecular electron dynamics also in large molecules.


A Stricter Heap Separating Points To Logic. Dynamic memory issues are hard to locate and may cost much of a development project's efforts and was repeatedly reported similarly afterwards independently by different persons. Verification as one formal method may proof a given program's heap matches a specified dynamic behaviour. Dynamic (or heap) memory, is the region within main memory that is manipulated by program statements like alloc, free and pointer manipulation during program execution. Usually, heap memory is allocated for problems where the amount of used memory is unknown prior to execution. Regions within the heap may be related "somehow" with each other, often, but not always, by pointers containing absolute addresses of related heap cells. The data structure described by all valid pointer variables manifests heap graphs. A heap graph is a directed connected simple graph within the dynamic memory which may contain cycles, and where each vertex represents an unique memory address and every edge links two heap vertices. The heap graph must be pointed by at least one variable from the local stack or a chain of other heap graphs which is finally pointed by at least one stacked variable. Heap vertices may not overlap. A heap formula expresses the assertion on dynamic memory and can either be a heaplet, or a recursively defined heap spatial or logical formula.


CAPT Contrastive Pre Training for Learning Denoised Sequence Representations. Pre trained self supervised models such as BERT have achieved striking success in learning sequence representations, especially for natural language processing. These models typically corrupt the given sequences with certain types of noise, such as masking, shuffling, or substitution, and then try to recover the original input. However, such pre training approaches are prone to learning representations that are covariant with the noise, leading to the discrepancy between the pre training and fine tuning stage. To remedy this, we present ContrAstive Pre Training (CAPT) to learn noise invariant sequence representations. The proposed CAPT encourages the consistency between representations of the original sequence and its corrupted version via unsupervised instance wise training signals. In this way, it not only alleviates the pretrain finetune discrepancy induced by the noise of pre training, but also aids the pre trained model in better capturing global semantics of the input via more effective sentence level supervision. Different from most prior work that focuses on a particular modality, comprehensive empirical evidence on 11 natural language understanding and cross modal tasks illustrates that CAPT is applicable for both language and vision language tasks, and obtains surprisingly consistent improvement, including 0.6 absolute gain on GLUE benchmarks and 0.8 absolute increment on text NLVR 2 .


Developing Careers in Physics Perspectives of Particle Physics Researchers from the VBScan network at various stages of their careers. Outlooks of particle physics researchers on their careers and the general challenges in establishing their careers over different career stages are surveyed using a questionnaire distributed to participants in an ERC funded research network, "VBScan". The respondents displayed a great deal of insight into what is needed for a career in academia, or more specifically particle physics, though they also did not downplay the element of "luck". Some notable differences between career levels could be observed in problems raised and attitudes towards careers.


Strong Log Concavity Does Not Imply Log Submodularity. We disprove a recent conjecture regarding discrete distributions and their generating polynomials stating that strong log concavity implies log submodularity.


Towards Bridging the Gap between Control and Self Adaptive System Properties. Two of the main paradigms used to build adaptive software employ different types of properties to capture relevant aspects of the system's run time behavior. On the one hand, control systems consider properties that concern static aspects like stability, as well as dynamic properties that capture the transient evolution of variables such as settling time. On the other hand, self adaptive systems consider mostly non functional properties that capture concerns such as performance, reliability, and cost. In general, it is not easy to reconcile these two types of properties or identify under which conditions they constitute a good fit to provide run time guarantees. There is a need of identifying the key properties in the areas of control and self adaptation, as well as of characterizing and mapping them to better understand how they relate and possibly complement each other. In this paper, we take a first step to tackle this problem by (1) identifying a set of key properties in control theory, (2) illustrating the formalization of some of these properties employing temporal logic languages commonly used to engineer self adaptive software systems, and (3) illustrating how to map key properties that characterize self adaptive software systems into control properties, leveraging their formalization in temporal logics. We illustrate the different steps of the mapping on an exemplar case in the cloud computing domain and conclude with identifying open challenges in the area.


A fully coupled numerical model of thermo hydro mechanical processes and fracture contact mechanics in porous media. A range of phenomena in the subsurface is characterised by the interplay between coupled thermal, hydraulic and mechanical processes and deforming structures such as fractures. Modelling subsurface dynamics can provide valuable phenomenological understanding, but requires models which faithfully represent the dynamics involved these models, therefore are themselves highly complex. This paper presents a mixed dimensional thermo hydro mechanical model designed to capture the process structure interplay using a discrete fracture matrix framework. It incorporates tightly coupled thermo hydro mechanical processes based on laws for momentum, mass and entropy in subdomains representing the matrix and the lower dimensional fractures and fracture intersections. The deformation of explicitly represented fractures is modelled by contact mechanics relations and a Coulomb friction law, with particular attention on coupling of fracture dilation to the governing equations in both fractures and matrix. The model is discretised using multi point finite volumes for the balance equations and a semismooth Newton scheme for the contact conditions and is implemented in the open source fracture simulation toolbox PorePy. Finally, simulation studies demonstrate the model's convergence, investigate process structure coupling effects, explore different fracture dilation models and show an application of the model to a 3d geothermal pressure stimulation and long term cooling scenario.


Strauss exponent for semilinear wave equations with scattering space dependent damping. It is believed or conjectured that the semilinear wave equations with scattering space dependent damping admit the Strauss critical exponent, see Ikehata Todorova Yordanov cite ITY (the bottom in page 2) and Nishihara Sobajima Wakasugi cite N2 (conjecture iii in page 4). In this work, we are devoted to showing the conjecture is true at least when the decay rate of the space dependent variable coefficients before the damping is larger than 2. Also, if the nonlinear term depends only on the derivative of the solution, we may prove the upper bound of the lifespan is the same as that of the solution of the corresponding problem without damping. This shows in another way the lq lq hyperbolicity" of the equation.


Improving Dialogue Breakdown Detection with Semi Supervised Learning. Building user trust in dialogue agents requires smooth and consistent dialogue exchanges. However, agents can easily lose conversational context and generate irrelevant utterances. These situations are called dialogue breakdown, where agent utterances prevent users from continuing the conversation. Building systems to detect dialogue breakdown allows agents to recover appropriately or avoid breakdown entirely. In this paper we investigate the use of semi supervised learning methods to improve dialogue breakdown detection, including continued pre training on the Reddit dataset and a manifold based data augmentation method. We demonstrate the effectiveness of these methods on the Dialogue Breakdown Detection Challenge (DBDC) English shared task. Our submissions to the 2020 DBDC5 shared task place first, beating baselines and other submissions by over 12 accuracy. In ablations on DBDC4 data from 2019, our semi supervised learning methods improve the performance of a baseline BERT model by 2 accuracy. These methods are applicable generally to any dialogue task and provide a simple way to improve model performance.


Direct proof of unconditional asymptotic consensus in the Hegselmann Krause model with transmission type delay. We present a direct proof of asymptotic consensus in the nonlinear Hegselmann Krause model with transmission type delay, where the communication weights depend on the particle distance in phase space. Our approach is based on an explicit estimate of the shrinkage of the group diameter on finite time intervals and avoids the usage of Lyapunov type functionals or results from nonnegative matrix theory. It works for both the original formulation of the model with communication weights scaled by the number of agents, and the modification with weights normalized a'la Motsch Tadmor. We pose only minimal assumptions on the model parameters. In particular, we only assume global positivity of the influence function, without imposing any conditions on its decay rate or monotonicity. Moreover, our result holds for any length of the delay.


The Entropy of Ricci Flows with Type I Scalar Curvature Bounds. In this paper, we extend the theory of Ricci flows satisfying a Type I scalar curvature condition at a finite time singularity. In Bam16 , Bamler showed that a Type I rescaling procedure will produce a singular shrinking gradient Ricci soliton with singularities of codimension 4. We prove that the entropy of a conjugate heat kernel based at the singular time converges to the soliton entropy of the singular soliton, and use this to characterize the singular set of the Ricci flow solution in terms of a heat kernel density function. This generalizes results previously only known with the stronger assumption of a Type I curvature bound. We also show that in dimension 4, the singular Ricci soliton is smooth away from finitely many points, which are conical smooth orbifold singularities


Convergence of volume forms on a family of log Calabi Yau varieties to a non Archimedean measure. We study the convergence of volume forms on a degenerating holomorphic family of log Calabi Yau varieties to a non Archimedean measure, extending a result of Boucksom and Jonsson. More precisely, let (X,B) be a holomorphic family of sub log canonical, log Calabi Yau complex varieties parameterized by the punctured unit disk. Let eta be a meromorphic volume form on X with poles along B . We show that the (possibly infinite) measures induced by the restriction of the eta to a fiber converge to a measure on the Berkovich analytification as we approach the puncture. The convergence takes place on a hybrid space, which is obtained by filling in the space X setminus B with the aforementioned Berkovich space over the puncture.


A Distributed Computing Perspective of Unconditionally Secure Information Transmission in Russian Cards Problems. The problem of A privately transmitting information to B by a public announcement overheard by an eavesdropper C is considered. To do so by a deterministic protocol, their inputs must be correlated. Dependent inputs are represented using a deck of cards. There is a publicly known signature (a,b,c) , where n a b c r , and A gets a cards, B gets b cards, and C gets c cards, out of the deck of n cards. Using a deterministic protocol, A decides its announcement based on her hand. Using techniques from coding theory, Johnson graphs, and additive number theory, a novel perspective inspired by distributed computing theory is provided, to analyze the amount of information that A needs to send, while preventing C from learning a single card of her hand. In one extreme, the generalized Russian cards problem, B wants to learn all of A 's cards, and in the other, B wishes to learn something about A 's hand.


Latent dynamical variables produce signatures of spatiotemporal criticality in large biological systems. Understanding the activity of large populations of neurons is difficult due to the combinatorial complexity of possible cell cell interactions. To reduce the complexity, coarse graining had been previously applied to experimental neural recordings, which showed over two decades of scaling in free energy, activity variance, eigenvalue spectra, and correlation time, hinting that the mouse hippocampus operates in a critical regime. We model the experiment by simulating conditionally independent binary neurons coupled to a small number of long timescale stochastic fields and then replicating the coarse graining procedure and analysis. This reproduces the experimentally observed scalings, suggesting that they may arise from coupling the neural population activity to latent dynamic stimuli. Further, parameter sweeps for our model suggest that emergence of scaling requires most of the cells in a population to couple to the latent stimuli, predicting that even the celebrated place cells must also respond to non place stimuli.


Active Crowd Counting with Limited Supervision. To learn a reliable people counter from crowd images, head center annotations are normally required. Annotating head centers is however a laborious and tedious process in dense crowds. In this paper, we present an active learning framework which enables accurate crowd counting with limited supervision given a small labeling budget, instead of randomly selecting images to annotate, we first introduce an active labeling strategy to annotate the most informative images in the dataset and learn the counting model upon them. The process is repeated such that in every cycle we select the samples that are diverse in crowd density and dissimilar to previous selections. In the last cycle when the labeling budget is met, the large amount of unlabeled data are also utilized a distribution classifier is introduced to align the labeled data with unlabeled data furthermore, we propose to mix up the distribution labels and latent representations of data in the network to particularly improve the distribution alignment in between training samples. We follow the popular density estimation pipeline for crowd counting. Extensive experiments are conducted on standard benchmarks i.e. ShanghaiTech, UCF CC 50, MAll, TRANCOS, and DCC. By annotating limited number of images (e.g. 10 of the dataset), our method reaches levels of performance not far from the state of the art which utilize full annotations of the dataset.


Quantifying Attention Flow in Transformers. In the Transformer model, "self attention" combines information from attended embeddings into the representation of the focal embedding in the next layer. Thus, across layers of the Transformer, information originating from different tokens gets increasingly mixed. This makes attention weights unreliable as explanations probes. In this paper, we consider the problem of quantifying this flow of information through self attention. We propose two methods for approximating the attention to input tokens given attention weights, attention rollout and attention flow, as post hoc methods when we use attention weights as the relative relevance of the input tokens. We show that these methods give complementary views on the flow of information, and compared to raw attention, both yield higher correlations with importance scores of input tokens obtained using an ablation method and input gradients.


On optimal ordering in the optimal stopping problem. In the classical optimal stopping problem, a player is given a sequence of random variables X 1 ldots X n with known distributions. After observing the realization of X i , the player can either accept the observed reward from X i and stop, or reject the observed reward from X i and continue to observe the next variable X i 1 in the sequence. Under any fixed ordering of the random variables, an optimal stopping policy, one that maximizes the player's expected reward, is given by the solution of a simple dynamic program. In this paper, we investigate the relatively less studied question of selecting the order in which the random variables should be observed so as to maximize the expected reward at the stopping time. To demonstrate the benefits of order selection, we prove a novel prophet inequality showing that, when the support of each random variable has size at most 2, the optimal ordering can achieve an expected reward that is within a factor of 1.25 of the expected hindsight maximum this is an improvement over the corresponding factor of 2 for the worst case ordering. We also provide a simple O(n 2) algorithm for finding an optimal ordering in this case. Perhaps surprisingly, we demonstrate that a slightly more general case each random variable X i is restricted to have 3 point support of form 0, m i, 1 is NP hard, and provide an FPTAS for that case.


On combinatorial optimization for dominating sets (literature survey, new models). The paper focuses on some versions of connected dominating set problems basic problems and multicriteria problems. A literature survey on basic problem formulations and solving approaches is presented. The basic connected dominating set problems are illustrated by simplifyed numerical examples. New integer programming formulations of dominating set problems (with multiset estimates) are suggested.


In Orbit Aerodynamic Coefficient Measurements using SOAR (Satellite for Orbital Aerodynamics Research). The Satellite for Orbital Aerodynamics Research (SOAR) is a CubeSat mission, due to be launched in 2021, to investigate the interaction between different materials and the atmospheric flow regime in very low Earth orbits (VLEO). Improving knowledge of the gas surface interactions at these altitudes and identification of novel materials that can minimise drag or improve aerodynamic control are important for the design of future spacecraft that can operate in lower altitude orbits. Such satellites may be smaller and cheaper to develop or can provide improved Earth observation data or communications link budgets and latency. Using precise orbit and attitude determination information and the measured atmospheric flow characteristics the forces and torques experienced by the satellite in orbit can be studied and estimates of the aerodynamic coefficients calculated. This paper presents the scientific concept and design of the SOAR mission. The methodology for recovery of the aerodynamic coefficients from the measured orbit, attitude, and in situ atmospheric data using a least squares orbit determination and free parameter fitting process is described and the experimental uncertainty of the resolved aerodynamic coefficients is estimated. The presented results indicate that the combination of the satellite design and experimental methodology are capable of clearly illustrating the variation of drag and lift coefficient for differing surface incidence angle. The lowest uncertainties for the drag coefficient measurement are found at approximately 300 km, whilst the measurement of lift coefficient improves for reducing orbital altitude to 200 km.


Java Decompiler Diversity and its Application to Meta decompilation. During compilation from Java source code to bytecode, some information is irreversibly lost. In other words, compilation and decompilation of Java code is not symmetric. Consequently, decompilation, which aims at producing source code from bytecode, relies on strategies to reconstruct the information that has been lost. Different Java decompilers use distinct strategies to achieve proper decompilation. In this work, we hypothesize that the diverse ways in which bytecode can be decompiled has a direct impact on the quality of the source code produced by decompilers. In this paper, we assess the strategies of eight Java decompilers with respect to three quality indicators syntactic correctness, syntactic distortion and semantic equivalence modulo inputs. Our results show that no single modern decompiler is able to correctly handle the variety of bytecode structures coming from real world programs. The highest ranking decompiler in this study produces syntactically correct, and semantically equivalent code output for 84 , respectively 78 , of the classes in our dataset. Our results demonstrate that each decompiler correctly handles a different set of bytecode classes. We propose a new decompiler called Arlecchino that leverages the diversity of existing decompilers. To do so, we merge partial decompilation into a new one based on compilation errors. Arlecchino handles 37.6 of bytecode classes that were previously handled by no decompiler. We publish the sources of this new bytecode decompiler.


Existence of a Stationary Navier Stokes Flow Past a Rigid Body, with Application to Starting Problem in Higher Dimensions. We consider the large time behavior of the Navier Stokes flow past a rigid body in mathbb R n with n geq 3 . We first construct a small stationary solution possessing the optimal summability at spatial infinity, which is the same as that of the Oseen fundamental solution. When the translational velocity of the body gradually increases and is maintained after a certain finite time, we then show that the nonstationary fluid motion converges to the stationary solution corresponding to a small terminal velocity of the body as time t rightarrow infty in L q with q in n, infty . This is called Finn's starting problem and the three dimensional case was affirmatively solved by Galdi, Heywood and Shibata (1997). The present paper extends their result to the case of higher dimensions. Even for the three dimensional case, our theorem provides new convergence rate, that is determined by the summability of the stationary solution at infinity and seems to be sharp.


Simplifying Activity on Edge Graphs. We formalize the simplification of activity on edge graphs used for visualizing project schedules, where the vertices of the graphs represent project milestones, and the edges represent either tasks of the project or timing constraints between milestones. In this framework, a timeline of the project can be constructed as a leveled drawing of the graph, where the levels of the vertices represent the time at which each milestone is scheduled to happen. We focus on the following problem given an activity on edge graph representing a project, find an equivalent activity on edge graph (one with the same critical paths) that has the minimum possible number of milestone vertices among all equivalent activity on edge graphs. We provide a polynomial time algorithm for solving this graph minimization problem.


Toric varieties from cyclic matrix semigroups. We present and expand some existing results on the Zariski closure of cyclic groups and semigroups of matrices. We show that, with the exclusion of isolated points, their irreducible components are toric varieties. Additionally, we demonstrate how every toric variety can be realized as the Zariski closure of a cyclic matrix group. Our paper includes a number of explicit examples and a note on existing computational results.


On some combinatorial properties of generalized cluster algebras. In this paper, we prove some combinatorial results on generalized cluster algebras. To be more precisely, we prove that (i) the seeds of a generalized cluster algebra mathcal A( mathcal S) whose clusters contain particular cluster variables form a connected subgraph of the exchange graph of mathcal A( mathcal S) (ii) there exists a bijection from the set of cluster variables of a generalized cluster algebra to the set of cluster variables of another generalized cluster algebra, if their initial exchange matrices satisfying a mild condition. Moreover, this bijection preserves the set of clusters of these two generalized cluster algebras. As applications of the second result, we prove some properties of the components of the d vectors of a generalized cluster algebra and we give a characterization for the clusters of a generalized cluster algebra.


Punishing defectors and rewarding cooperators Do people discriminate between genders?. Do people discriminate between men and women when they have the option to punish defectors or reward cooperators? Here we report on four pre registered experiments, that shed some light on this question. Study 1 (N 544) shows that people do not discriminate between genders when they have the option to punish (reward) defectors (cooperators) in a one shot prisoner's dilemma with third party punishment reward. Study 2 (N 253) extends Study 1 to a different method of punishing rewarding participants are asked to rate the behaviour of a defector cooperator on a scale of 1 to 5 stars. In this case too, we find that people do not discriminate between genders. Study 3a (N 331) and Study 3b (N 310) conceptually replicate Study 2 with a slightly different gender manipulation. These latter studies show that, in situations where they do not have specific beliefs about the gender of the defector cooperator's partner, neither men nor women discriminate between genders.


Transport of patterns by Burge transpose. We take the first steps in developing a theory of transport of patterns from Fishburn permutations to (modified) ascent sequences. Given a set of pattern avoiding Fishburn permutations, we provide an explicit construction for the basis of the corresponding set of modified ascent sequences. Our approach is in fact more general and can transport patterns between permutations and equivalence classes of so called Cayley permutations. This transport of patterns relies on a simple operation we call the Burge transpose. It operates on certain biwords called Burge words. Moreover, using mesh patterns on Cayley permutations, we present an alternative view of the transport of patterns as a Wilf equivalence between subsets of Cayley permutations. We also highlight a connection with primitive ascent sequences.


Probabilistic Analysis of Replicator Mutator Equations. This paper introduces a general class of Replicator Mutator equations on a multi dimensional fitness space. We establish a novel probabilistic representation of weak solutions of the equation by using the theory of Fockker Planck Kolmogorov (FPK) equations and a martingale extraction approach. The examples with closed form probabilistic solutions for different fitness functions considered in the existing literature are provided. We also construct a particle system and prove a general convergence result to any solution to the FPK equation associated with the extended Replicator Mutator equation with respect to a Wasserstein like distance adapted to our probabilistic framework.


Non monotonic Logical Reasoning Guiding Deep Learning for Explainable Visual Question Answering. State of the art algorithms for many pattern recognition problems rely on deep network models. Training these models requires a large labeled dataset and considerable computational resources. Also, it is difficult to understand the working of these learned models, limiting their use in some critical applications. Towards addressing these limitations, our architecture draws inspiration from research in cognitive systems, and integrates the principles of commonsense logical reasoning, inductive learning, and deep learning. In the context of answering explanatory questions about scenes and the underlying classification problems, the architecture uses deep networks for extracting features from images and for generating answers to queries. Between these deep networks, it embeds components for non monotonic logical reasoning with incomplete commonsense domain knowledge, and for decision tree induction. It also incrementally learns and reasons with previously unknown constraints governing the domain's states. We evaluated the architecture in the context of datasets of simulated and real world images, and a simulated robot computing, executing, and providing explanatory descriptions of plans. Experimental results indicate that in comparison with an end to end'' architecture of deep networks, our architecture provides better accuracy on classification problems when the training dataset is small, comparable accuracy with larger datasets, and more accurate answers to explanatory questions. Furthermore, incremental acquisition of previously unknown constraints improves the ability to answer explanatory questions, and extending non monotonic logical reasoning to support planning and diagnostics improves the reliability and efficiency of computing and executing plans on a simulated robot.


SurFi Detecting Surveillance Camera Looping Attacks with Wi Fi Channel State Information (Extended Version). The proliferation of surveillance cameras has greatly improved the physical security of many security critical properties including buildings, stores, and homes. However, recent surveillance camera looping attacks demonstrate new security threats adversaries can replay a seemingly benign video feed of a place of interest while trespassing or stealing valuables without getting caught. Unfortunately, such attacks are extremely difficult to detect in real time due to cost and implementation constraints. In this paper, we propose SurFi to detect these attacks in real time by utilizing commonly available Wi Fi signals. In particular, we leverage that channel state information (CSI) from Wi Fi signals also perceives human activities in the place of interest in addition to surveillance cameras. SurFi processes and correlates the live video feeds and the Wi Fi CSI signals to detect any mismatches that would identify the presence of the surveillance camera looping attacks. SurFi does not require the deployment of additional infrastructure because Wi Fi transceivers are easily found in the urban indoor environment. We design and implement the SurFi system and evaluate its effectiveness in detecting surveillance camera looping attacks. Our evaluation demonstrates that SurFi effectively identifies attacks with up to an attack detection accuracy of 98.8 and 0.1 false positive rate


A note on isotropic discrepancy and spectral test of lattice point sets. We show that the isotropic discrepancy of a lattice point set can be bounded from below and from above in terms of the spectral test of the corresponding integration lattice. From this we deduce that the isotropic discrepancy of any N element lattice point set in 0,1) d is at least of order N 1 d . This order of magnitude is best possible for lattice point sets in dimension d .


On the mod 2 cohomology of some 2 Postnikov towers. The present note presents some results about the mod 2 cohomology, modulo nilpotent elements elements of the fiber E of a decomposable map psi K(Z, 2) rightarrow K(Z 2, p). This is more an announcement and a brief description of the tools that are used Lannes' T functor and the Eilenberg Moore spectral sequence.


An Extension of the Cardioid Distributions on Circle. A new family of distributions on the circle is introduced which are a generalization of the Cardioid distributions. The elementary properties such as mean, variance and the characteristic function are computed. The distribution is either unimodal or bimodal. The modes are computed. The symmetry of the distribution is characterized. The parameters are shown to be canonic (i.e. uniquely determined by the distribution). We also show that this new family is a subset of distributions whose Fourier series has degree at most 2 and study the implications of this property.


EGGS A Flexible Approach to Relational Modeling of Social Network Spam. Social networking websites face a constant barrage of spam, unwanted messages that distract, annoy, and even defraud honest users. These messages tend to be very short, making them difficult to identify in isolation. Furthermore, spammers disguise their messages to look legitimate, tricking users into clicking on links and tricking spam filters into tolerating their malicious behavior. Thus, some spam filters examine relational structure in the domain, such as connections among users and messages, to better identify deceptive content. However, even when it is used, relational structure is often exploited in an incomplete or ad hoc manner. In this paper, we present Extended Group based Graphical models for Spam (EGGS), a general purpose method for classifying spam in online social networks. Rather than labeling each message independently, we group related messages together when they have the same author, the same content, or other domain specific connections. To reason about related messages, we combine two popular methods stacked graphical learning (SGL) and probabilistic graphical models (PGM). Both methods capture the idea that messages are more likely to be spammy when related messages are also spammy, but they do so in different ways SGL uses sequential classifier predictions and PGMs use probabilistic inference. We apply our method to four different social network domains. EGGS is more accurate than an independent model in most experimental settings, especially when the correct label is uncertain. For the PGM implementation, we compare Markov logic networks to probabilistic soft logic and find that both work well with neither one dominating, and the combination of SGL and PGMs usually performs better than either on its own.


Nearly Linear Time, Parallelizable Algorithms for Non Monotone Submodular Maximization. We study parallelizable algorithms for maximization of a submodular function, not necessarily monotone, with respect to a cardinality constraint k . We improve the best approximation factor achieved by an algorithm that has optimal adaptivity and query complexity, up to logarithmic factors in the size n of the ground set, from 0.039 epsilon to 0.193 epsilon . We provide two algorithms the first has approximation ratio 1 6 epsilon , adaptivity O( log n ) , and query complexity O( n log k ) , while the second has approximation ratio 0.193 epsilon , adaptivity O( log 2 n ) , and query complexity O(n log k) . Heuristic versions of our algorithms are empirically validated to use a low number of adaptive rounds and total queries while obtaining solutions with high objective value in comparison with state of the art approximation algorithms, including continuous algorithms that use the multilinear extension.


An improved non reflecting outlet boundary condition for weakly compressible SPH. Implementation of an outlet boundary condition is challenging in the context of the weakly compressible Smoothed Particle Hydrodynamics method. We perform a systematic numerical study of several of the available techniques for the outlet boundary condition. We propose a new hybrid approach that combines a characteristics based method with a simpler frozen particle (do nothing) technique to accurately satisfy the outlet boundary condition in the context of wind tunnel like simulations. In addition, we suggest some improvements to the do nothing approach. We introduce a new suite of test problems that make it possible to compare these techniques carefully. We then simulate the flow past a backward facing step and circular cylinder. The proposed method allows us to obtain accurate results with an order of magnitude less particles than those presented in recent research. We provide a completely open source implementation and a reproducible manuscript.


Degree spectra for transcendence in fields. We show that for both the unary relation of transcendence and the finitary relation of algebraic independence on a field, the degree spectra of these relations may consist of any single computably enumerable Turing degree, or of those c.e. degrees above an arbitrary fixed Delta 0 2 degree. In other cases, these spectra may be characterized by the ability to enumerate an arbitrary Sigma 0 2 set. This is the first proof that a computable field can fail to have a computable copy with a computable transcendence basis.


Transfer Learning and Distant Supervision for Multilingual Transformer Models A Study on African Languages. Multilingual transformer models like mBERT and XLM RoBERTa have obtained great improvements for many NLP tasks on a variety of languages. However, recent works also showed that results from high resource languages could not be easily transferred to realistic, low resource scenarios. In this work, we study trends in performance for different amounts of available resources for the three African languages Hausa, isiXhosa and Yor ub 'a on both NER and topic classification. We show that in combination with transfer learning or distant supervision, these models can achieve with as little as 10 or 100 labeled sentences the same performance as baselines with much more supervised training data. However, we also find settings where this does not hold. Our discussions and additional experiments on assumptions such as time and hardware restrictions highlight challenges and opportunities in low resource learning.


A Scenario Based Development Framework for Autonomous Driving. This article summarizes the research progress of scenario based testing and development technology for autonomous vehicles. We systematically analyzed previous research works and proposed the definition of scenario, the elements of the scenario ontology, the data source of the scenario, the processing method of the scenario data, and scenario based V Model. Moreover, we summarized the automated test scenario construction method by random scenario generation and dangerous scenario generation.


Geometric calculus on pseudo Riemannian manifolds. This article provides a pedagogically oriented introduction to geometric (Clifford) calculus on pseudo Riemannian manifolds. Unlike usual approaches to the topic, which rely on embedding the geometric algebra either within a tensor algebra or within a vector manifold framework, here we define geometric calculus directly, by elementary methods. In particular we use an axiomatic approach that directly parallels textbook introductions to general relativity and pseudo Riemannian geometry, so that no structure outside the metrical Clifford bundle of the manifold need be introduced. On this basis we develop the full theory of differential calculus for vector, multivector, and tensor fields.


The universal property of infinite direct sums in C categories and W categories. When formulating universal properties for objects in a dagger category, one usually expects a universal property to characterize the universal object up to unique unitary isomorphism. We observe that this is automatically the case in the important special case of C categories, provided that one uses enrichment in Banach spaces. We then formulate such a universal property for infinite direct sums in C categories, and prove the equivalence with the existing definition due to Ghez, Lima and Roberts in the case of W categories. These infinite direct sums specialize to the usual ones in the category of Hilbert spaces, and more generally in any W category of normal representations of a W algebra. Finding a universal property for the more general case of direct integrals remains an open problem.


Transition based Semantic Dependency Parsing with Pointer Networks. Transition based parsers implemented with Pointer Networks have become the new state of the art in dependency parsing, excelling in producing labelled syntactic trees and outperforming graph based models in this task. In order to further test the capabilities of these powerful neural networks on a harder NLP problem, we propose a transition system that, thanks to Pointer Networks, can straightforwardly produce labelled directed acyclic graphs and perform semantic dependency parsing. In addition, we enhance our approach with deep contextualized word embeddings extracted from BERT. The resulting system not only outperforms all existing transition based models, but also matches the best fully supervised accuracy to date on the SemEval 2015 Task 18 English datasets among previous state of the art graph based parsers.


Highway to HAL Open Sourcing the First Extendable Gate Level Netlist Reverse Engineering Framework. Since hardware oftentimes serves as the root of trust in our modern interconnected world, malicious hardware manipulations constitute a ubiquitous threat in the context of the Internet of Things (IoT). Hardware reverse engineering is a prevalent technique to detect such manipulations. Over the last years, an active research community has significantly advanced the field of hardware reverse engineering. Notably, many open research questions regarding the extraction of functionally correct netlists from Field Programmable Gate Arrays (FPGAs) or Application Specific Integrated Circuits (ASICs) have been tackled. In order to facilitate further analysis of recovered netlists, a software framework is required, serving as the foundation for specialized algorithms. Currently, no such framework is publicly available. Therefore, we provide the first open source gate library agnostic framework for gate level netlist analysis. In this positional paper, we demonstrate the workflow of our modular framework HAL on the basis of two case studies and provide profound insights on its technical foundations.


Generalized principal eigenvalues of convex nonlinear elliptic operators in mathbb R N . We study the generalized eigenvalue problem in mathbb R N for a general convex nonlinear elliptic operator which is locally elliptic and positively 1 homogeneous. Generalizing article of Berestycki and Rossi in Comm. Pure Appl. Math. 68 (2015), no. 6, 1014 1065 we consider three different notions of generalized eigenvalues and compare them. We also discuss the maximum principles and uniqueness of principal eigenfunctions.


Robust Machine Translation with Domain Sensitive Pseudo Sources Baidu OSU WMT19 MT Robustness Shared Task System Report. This paper describes the machine translation system developed jointly by Baidu Research and Oregon State University for WMT 2019 Machine Translation Robustness Shared Task. Translation of social media is a very challenging problem, since its style is very different from normal parallel corpora (e.g. News) and also include various types of noises. To make it worse, the amount of social media parallel corpora is extremely limited. In this paper, we use a domain sensitive training method which leverages a large amount of parallel data from popular domains together with a little amount of parallel data from social media. Furthermore, we generate a parallel dataset with pseudo noisy source sentences which are back translated from monolingual data using a model trained by a similar domain sensitive way. We achieve more than 10 BLEU improvement in both En Fr and Fr En translation compared with the baseline methods.


Adaptive In network Collaborative Caching for Enhanced Ensemble Deep Learning at Edge. To enhance the quality and speed of data processing and protect the privacy and security of the data, edge computing has been extensively applied to support data intensive intelligent processing services at edge. Among these data intensive services, ensemble learning based services can in natural leverage the distributed computation and storage resources at edge devices to achieve efficient data collection, processing, analysis. Collaborative caching has been applied in edge computing to support services close to the data source, in order to take the limited resources at edge devices to support high performance ensemble learning solutions. To achieve this goal, we propose an adaptive in network collaborative caching scheme for ensemble learning at edge. First, an efficient data representation structure is proposed to record cached data among different nodes. In addition, we design a collaboration scheme to facilitate edge nodes to cache valuable data for local ensemble learning, by scheduling local caching according to a summarization of data representations from different edge nodes. Our extensive simulations demonstrate the high performance of the proposed collaborative caching scheme, which significantly reduces the learning latency and the transmission overhead.


Evaluation of the Spatio Temporal features and GAN for Micro expression Recognition System. Owing to the development and advancement of artificial intelligence, numerous works were established in the human facial expression recognition system. Meanwhile, the detection and classification of micro expressions are attracting attentions from various research communities in the recent few years. In this paper, we first review the processes of a conventional optical flow based recognition system, which comprised of facial landmarks annotations, optical flow guided images computation, features extraction and emotion class categorization. Secondly, a few approaches have been proposed to improve the feature extraction part, such as exploiting GAN to generate more image samples. Particularly, several variations of optical flow are computed in order to generate optimal images to lead to high recognition accuracy. Next, GAN, a combination of Generator and Discriminator, is utilized to generate new "fake" images to increase the sample size. Thirdly, a modified state of the art Convolutional neural networks is proposed. To verify the effectiveness of the the proposed method, the results are evaluated on spontaneous micro expression databases, namely SMIC, CASME II and SAMM. Both the F1 score and accuracy performance metrics are reported in this paper.


Fast Compliance Checking with General Vocabularies. We address the problem of complying with the GDPR while processing and transferring personal data on the web. For this purpose we introduce an extensible profile of OWL2 for representing data protection policies. With this language, a company's data usage policy can be checked for compliance with data subjects' consent and with a formalized fragment of the GDPR by means of subsumption queries. The outer structure of the policies is restricted in order to make compliance checking highly scalable, as required when processing high frequency data streams or large data volumes. However, the vocabularies for specifying policy properties can be chosen rather freely from expressive Horn fragments of OWL2. We exploit IBQ reasoning to integrate specialized reasoners for the policy language and the vocabulary's language. Our experiments show that this approach significantly improves performance.


Ultrafast transfer and transient entrapment of photoexcited Mg electron in Mg C60. Electron relaxation is studied in endofullerene Mg C60, after an initial localized photoexcitation in Mg, by nonadiabtic molecular dynamics simulations. To ensure reliability, two methods are used i) an independent particle approach with a DFT description of the ground state and ii) HF ground state with many body effects for the excited state dynamics. Both methods exhibit similar relaxation times leading to an ultrafast decay and charge transfer from Mg to C60 within tens of femtoseconds. Method (i) further elicits a robust transient trap of the transferred electron that can delay the electron hole recombination. Results shall motivate experiments to probe these ultrafast processes by two photon transient absorption spectroscopy in gas phase, in solution, or as thin films.


MimicNorm Weight Mean and Last BN Layer Mimic the Dynamic of Batch Normalization. Substantial experiments have validated the success of Batch Normalization (BN) Layer in benefiting convergence and generalization. However, BN requires extra memory and float point calculation. Moreover, BN would be inaccurate on micro batch, as it depends on batch statistics. In this paper, we address these problems by simplifying BN regularization while keeping two fundamental impacts of BN layers, i.e., data decorrelation and adaptive learning rate. We propose a novel normalization method, named MimicNorm, to improve the convergence and efficiency in network training. MimicNorm consists of only two light operations, including modified weight mean operations (subtract mean values from weight parameter tensor) and one BN layer before loss function (last BN layer). We leverage the neural tangent kernel (NTK) theory to prove that our weight mean operation whitens activations and transits network into the chaotic regime like BN layer, and consequently, leads to an enhanced convergence. The last BN layer provides autotuned learning rates and also improves accuracy. Experimental results show that MimicNorm achieves similar accuracy for various network structures, including ResNets and lightweight networks like ShuffleNet, with a reduction of about 20 memory consumption. The code is publicly available at https github.com Kid key MimicNorm.


The N stars network evolution model. A new network evolution model is introduced in this paper. The model is based on co operations of N units. The units are the nodes of the network and the co operations are indicated by directed links. At each evolution step N units co operate which formally means that they form a directed N star subgraph. At each step either a new unit joins to the network and it co operates with N 1 old units or N old units co operate. During the evolution both preferential attachment and uniform choice are applied. Asymptotic power law distributions are obtained both for the in degrees and the out degrees.


DeePCCI Deep Learning based Passive Congestion Control Identification. Transport protocols use congestion control to avoid overloading a network. Nowadays, different congestion control variants exist that influence performance. Studying their use is thus relevant, but it is hard to identify which variant is used. While passive identification approaches exist, these require detailed domain knowledge and often also rely on outdated assumptions about how congestion control operates and what data is accessible. We present DeePCCI, a passive, deep learning based congestion control identification approach which does not need any domain knowledge other than training traffic of a congestion control variant. By only using packet arrival data, it is also directly applicable to encrypted (transport header) traffic. DeePCCI is therefore more easily extendable and can also be used with QUIC.


Intuitionistic Linear Temporal Logics. We consider intuitionistic variants of linear temporal logic with next', until' and release' based on expanding posets partial orders equipped with an order preserving transition function. This class of structures gives rise to a logic which we denote iltl , and by imposing additional constraints we obtain the logics itlb of persistent posets and itlht of here and there temporal logic, both of which have been considered in the literature. We prove that iltl has the effective finite model property and hence is decidable, while itlb does not have the finite model property. We also introduce notions of bounded bisimulations for these logics and use them to show that the until' and release' operators are not definable in terms of each other, even over the class of persistent posets.


A development of Lagrange interpolation, Part I Theory. In this work, we introduce the new class of functions which can use to solve the nonlinear linear multi dimensional differential equations. Based on these functions, a numerical method is provided which is called the Developed Lagrange Interpolation (DLI). For this, firstly, we define the new class of the functions, called the Developed Lagrange Functions (DLFs), which satisfy in the Kronecker Delta at the collocation points. Then, for the DLFs, the first order derivative operational matrix of textbf D (1) is obtained, and a recurrence relation is provided to compute the high order derivative operational matrices of textbf D (m) , m in mathbb N that is, we develop the theorem of the derivative operational matrices of the classical Lagrange polynomials for the DLFs and show that the relation of textbf D (m) ( textbf D (1) ) m for the DLFs is not established and is developable. Finally, we develop the error analysis of the classical Lagrange interpolation for the developed Lagrange interpolation. Finally, for demonstrating the convergence and efficiency of the DLI, some well known differential equations, which are applicable in applied sciences, have been investigated based upon the various choices of the points of interpolation collocation.


Reconstruction of Bandlimited Functions from Space Time Samples. For a wide family of even kernels varphi u, u in I , we describe discrete sets Lambda such that every bandlimited signal f can be reconstructed from the space time samples (f ast varphi u)( lambda), lambda in Lambda, u in I .


The phaseless rank of a matrix. We consider the problem of finding the smallest rank of a complex matrix whose absolute values of the entries are given. We call this minimum the phaseless rank of the matrix of the entrywise absolute values. In this paper we study this quantity, extending a classic result of Camion and Hoffman and connecting it to the study of amoebas of determinantal varieties and of semidefinite representations of convex sets. As a consequence, we prove that the set of maximal minors of a matrix of indeterminates form an amoeba basis for the ideal they define, and we attain a new upper bound on the complex semidefinite extension complexity of polytopes, dependent only on their number of vertices and facets. We also highlight the connections between the notion of phaseless rank and the problem of finding large sets of complex equiangular lines or mutually unbiased bases.


Aspect based Academic Search using Domain specific KB. Academic search engines allow scientists to explore related work relevant to a given query. Often, the user is also aware of the "aspect" to retrieve a relevant document. In such cases, existing search engines can be used by expanding the query with terms describing that aspect. However, this approach does not guarantee good results since plain keyword matches do not always imply relevance. To address this issue, we define and solve a novel academic search task, called "aspect based retrieval", which allows the user to specify the aspect along with the query to retrieve a ranked list of relevant documents. The primary idea is to estimate a language model for the aspect as well as the query using a domain specific knowledge base and use a mixture of the two to determine the relevance of the article. Our evaluation of the results over the Open Research Corpus dataset shows that our method outperforms keyword based expansion of query with aspect with and without relevance feedback.


width k Eulerian polynomials of type A and B and its Gamma positivity. We define some generalizations of the classical descent and inversion statistics on signed permutations that arise from the work of Sack and Ulfarsson 20 and called after width k descents and width k inversionsof type A in Davis's work 8 . Using the aforementioned new statistics, we derive some new generalizations of Eulerian polynomials of type A, B and D. It should also be noticed that we establish the Gamma positivity of the "width k" Eulerian polynomials and we give a combinatorial interpretation of finite sequences associated to these new polynomials using quasisymmetric functions and P partition in Petersen's work 18 .


High Sensitivity Hybrid PbS CQD TMDC Photodetectors up to 2 mu m. Recent approaches to develop infrared photodetectors characterized by high sensitivities, broadband spectral coverage, easy integration with silicon electronics and low cost have been based on hybrid structures of transition metal dichalcogenides (TMDCs) and PbS colloidal quantum dots (CQDs). However, to date, such photodetectors have been reported with high sensitivity up to 1.5 mu m. Here we extend the spectral coverage of this technology towards 2 mu m demonstrating for the first time compelling performance with responsivities 1400 A W at 1.8 mu m with 1V bias and detectivities as high as 10 12 Jones at room temperature. To do this we studied two TMDC materials as a carrier transport layer, tungsten disulfide (WS 2 ) and molybdenum disulfide (MoS 2 ) and demonstrate that WS 2 based hybrid photodetectors outperform those of MoS 2 due to a more adequate band alignment that favors carrier transfer from the CQDs.


Contextual Recurrent Units for Cloze style Reading Comprehension. Recurrent Neural Networks (RNN) are known as powerful models for handling sequential data, and especially widely utilized in various natural language processing tasks. In this paper, we propose Contextual Recurrent Units (CRU) for enhancing local contextual representations in neural networks. The proposed CRU injects convolutional neural networks (CNN) into the recurrent units to enhance the ability to model the local context and reducing word ambiguities even in bi directional RNNs. We tested our CRU model on sentence level and document level modeling NLP tasks sentiment classification and reading comprehension. Experimental results show that the proposed CRU model could give significant improvements over traditional CNN or RNN models, including bidirectional conditions, as well as various state of the art systems on both tasks, showing its promising future of extensibility to other NLP tasks as well.


Modeling and simulation of large scale Systems a systematic comparison of modeling paradigms. A trend across most areas where simulation driven development is used is the ever increasing size and complexity of the systems under consideration, pushing established methods of modeling and simulation towards their limits. This paper complements existing surveys on large scale modeling and simulation of physical systems by conducting expert surveys. We conducted a two stage empirical survey in order to investigate research needs, current challenges as well as promising modeling and simulation paradigms. Furthermore, we applied the analytic hierarchy process method to prioritise the strengths and weakness of different modeling paradigms. The results of this study show that experts consider acausal modeling techniques to be suitable for modeling large scale systems, while causal techniques are considered less suitable.


Asymmetric frequency conversion with acoustic non Hermitian space time varying metamaterial. Space time modulated metamaterials support extraordinary rich applications, such as parametric amplification, frequency conversion and non reciprocal transmission. However, experimental realization of space time modulation is highly non trivial, hindering many interesting physics that are theoretically predicted to be experimentally demonstrated. Here, based on the proposed virtualized metamaterials with software defined impulse response, we experimentally realize non Hermitian space time varying metamaterials for efficient and asymmetric frequency conversion by allowing material gain and loss to be tailor made and balanced in the time domain. In the application of frequency conversion, the combination of space time varying capability and non Hermiticity allows us to diminish the main band through gain loss balance and to increase the efficiency of side band conversion at the same time. In addition, our approach of software defined metamaterials is flexible to realize the analogy of quantum interference in an acoustic system with design capability. Applying an additional modulation phase delay between different atoms allows to control such interference to get asymmetric amplification in frequency conversion.


Common divisors of totients of polynomial sequences. Motivated by a question of Venkataramana, we consider the greatest common divisor of phi(f(n)) where f is a primitive polynomial with integer coefficients, and n ranges over all natural numbers. Assuming Schinzel's hypothesis, we establish that this gcd may be bounded just in terms of the degree of the polynomial f . Unconditionally we establish such a bound for quadratic polynomials, as well as polynomials that split completely into linear factors. The paper also addresses a question of Calegari, and establishes that there are infinitely many n such that n 2 1 is not divisible by any prime equiv 1 bmod 2 m provided m is a large fixed integer.


Research on dynamic target detection and tracking system of hexapod robot. Dynamic target detection and target tracking are hot issues in the field of image. In order to explore its application value in the field of mobile robot, a dynamic target detection and tracking system is designed based on hexapod robot. Firstly, the dynamic target detection method is introduced with region merging and adaptive external point filtering based on motion compensation method. This method achieves the accurate compensation of the moving background through symmetric matching and adaptive external point filtering, and achieves complete detection of non rigid objects by region merging. Secondly, the application of target tracking algorithm based on KCF in hexapod robot platform is studied, and the Angle tracking of moving target is realized by adaptive adjustment of tracking speed. The last, the architecture of robot monitoring system is designed, which consists of operator, processor, hexapod robot and vision sensor, and the moving object detection and tracking algorithm proposed in this paper is applied to the system. The experimental results show that the improved algorithm can effectively detect and track the moving target when applied to the system of the mobile hexapod robot.


Engineering Data Reduction for Nested Dissection. Many applications rely on time intensive matrix operations, such as factorization, which can be sped up significantly for large sparse matrices by interpreting the matrix as a sparse graph and computing a node ordering that minimizes the so called fill in. In this paper, we engineer new data reduction rules for the minimum fill in problem, which significantly reduce the size of the graph while producing an equivalent (or near equivalent) instance. By applying both new and existing data reduction rules exhaustively before nested dissection, we obtain improved quality and at the same time large improvements in running time on a variety of instances. Our overall algorithm outperforms the state of the art significantly it not only yields better elimination orders, but it does so significantly faster than previously possible. For example, on road networks, where nested dissection algorithms are typically used as a preprocessing step for shortest path computations, our algorithms are on average six times faster than Metis while computing orderings with less fill in.


The reflection representation in the homology of subword order. We investigate the homology representation of the symmetric group on rank selected subposets of subword order. We show that the homology module for words of bounded length, over an alphabet of size n, decomposes into a sum of tensor powers of the S n irreducible S (n 1,1) indexed by the partition (n 1,1), recovering, as a special case, a theorem of Bj "orner and Stanley for words of length at most k. For arbitrary ranks we show that the homology is an integer combination of positive tensor powers of the reflection representation S (n 1,1) , and conjecture that this combination is nonnegative. We uncover a curious duality in homology in the case when one rank is deleted. We prove that the action on the rank selected chains of subword order is a nonnegative integer combination of tensor powers of S (n 1,1) , and show that its Frobenius characteristic is h positive and supported on the set T 1 (n) h lambda lambda (n r, 1 r), r ge 1 . Our most definitive result describes the Frobenius characteristic of the homology for an arbitrary set of ranks, plus or minus one copy of the Schur function s (n 1,1) , as an integer combination of the set T 2 (n) h lambda lambda (n r, 1 r), r ge 2 . We conjecture that this combination is nonnegative, establishing this fact for particular cases.


Workflow Management on BFT Blockchains. Blockchain technology has been proposed as a new infrastructure technology for a wide variety of novel applications. Blockchains provide an immutable record of transactions, making them useful when business actors do not trust each other. Their distributed nature makes them suitable for inter organizational applications. However, proof of work based blockchains are computationally inefficient and do not provide final consensus, although they scale well to large networks. In contrast, blockchains built around Byzantine Fault Tolerance (BFT) algorithms are more efficient and provide immediate and final consensus, but do not scale well to large networks. We argue that this makes them well suited for workflow management applications that typically include no more than a few dozen participants but require final consensus. In this paper, we discuss architectural options and present a prototype implementation of a BFT blockchain based workflow management system (WfMS).


Singlet fission for quantum information and quantum computing The parallel JDE model. Singlet fission is a photoconversion process that generates a doubly excited, maximally spin entangled pair state. This state has applications to quantum information and computing that are only beginning to be realized. In this article, we construct and analyze a spin exciton hamiltonian to describe the dynamics of the two triplet state. We find the selection rules that connect the doubly excited, spin singlet state to the manifold of quintet states and comment on the mechanism and conditions for the transition into formally independent triplets. For adjacent dimers that are oriented and immobilized in an inert host, singlet fission can be strongly state selective. We make predictions for electron paramagnetic resonance experiments and re assign some transitions from recent literature. Our results give conditions for which magnetic resonance pulses can drive transitions between optically polarized magnetic sublevels of the two exciton states, making it possible to realize quantum gates at room temperature in these systems.