Human Generated Data

Title

Untitled (New Year's greeting card mock-up with family's four children)
Date

1962
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10192

Human Generated Data

Title

Untitled (New Year's greeting card mock-up with family's four children)

People

Artist: Martin Schweig, American 20th century

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Collage 99.9
Poster 99.9
Advertisement 99.9
Person 99.4
Human 99.4
Person 98.1
Person 70.3
Text 64
Apparel 57.5
Clothing 57.5
Canvas 56.9
Girl 56.7
Female 56.7

Imagga
created on 2022-01-22

person 32.4
people 30.1
happy 26.3
adult 25.3
indoors 22
man 20.2
business 18.8
portrait 18.8
smile 18.5
smiling 18.1
office 17.1
blackboard 16.7
looking 16
home 16
work 15.7
student 15.5
attractive 15.4
computer 15.2
male 14.9
pretty 14.7
room 14.5
locker 14.1
laptop 13.7
women 12.7
refrigerator 12.3
cheerful 12.2
patient 12.2
sliding door 12.1
education 12.1
technology 11.9
happiness 11.8
space 11.6
holding 11.6
fastener 11.4
hand 11.4
standing 11.3
door 11.2
corporate 11.2
sitting 11.2
child 11.1
school 11.1
horizontal 10.9
board 10.9
daughter 10.8
one 10.5
white goods 10.5
study 10.3
businesswoman 10
face 9.9
modern 9.8
professional 9.8
family 9.8
worker 9.8
lady 9.7
interior 9.7
drawing 9.5
learn 9.4
lifestyle 9.4
senior 9.4
two 9.3
case 9.3
mature 9.3
occupation 9.2
classroom 9.2
indoor 9.1
hospital 9.1
device 8.9
working 8.8
brunette 8.7
cute 8.6
restraint 8.6
doctor 8.5
communication 8.4
old 8.4
home appliance 8.2
paper 8.2
mother 8
copy 8
appliance 7.8
teach 7.8
class 7.7
exam 7.7
card 7.7
casual 7.6
writing 7.5
teacher 7.4
executive 7.4
20s 7.3
teenager 7.3
movable barrier 7.3
sketch 7.2
kid 7.1
medical 7.1

Google
created on 2022-01-22

Human 89.7
Font 81.4
Art 81.2
Adaptation 79.2
Handwriting 76
Snapshot 74.3
Design 68.5
Paper 67.8
Pattern 67.3
Visual arts 64.9
Paper product 64.9
Room 64.6
Child 60.9
Publication 55.7
Photographic paper 55.4
Vintage clothing 55.1
Rectangle 50.3
Illustration 50.3

Microsoft
created on 2022-01-22

text 99.9
whiteboard 91.3
handwriting 89.3
person 68.1
human face 61.1

Face analysis

Amazon

Google

AWS Rekognition

Age 6-14
Gender Female, 82.6%
Calm 97.1%
Sad 1.5%
Surprised 0.5%
Disgusted 0.3%
Happy 0.3%
Confused 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Female, 90.2%
Sad 99.7%
Calm 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%
Happy 0%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people posing for the camera 63%
a group of people posing for a photo 53.7%
a group of people sitting on a whiteboard 53.6%

Text analysis

Amazon

from
the
New
a
Kim
a belated New Years
belated
all
all the Conauts
Years
"burro"
L
Conauts
SUSiE
sunday
greeting

Google

Neu
qruetiny
Hhe
Kim
a belaled Neu Years qruetiny from Au Hhe Conauts Kim SusiE "burro" suniday"
belaled
Conauts
SusiE
from
Au
a
Years
"burro"
suniday"