Human Generated Data

Title

Untitled (children gathered around lap of santa in residential house)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9139

Human Generated Data

Title

Untitled (children gathered around lap of santa in residential house)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.4
Person 99
Person 98.1
Person 96.4
Person 95.3
Person 94.5
Person 88.1
Person 88.1
Accessory 86.8
Sunglasses 86.8
Accessories 86.8
Person 84
Person 82
Photographer 78.2
Clothing 69
Apparel 69
People 67.4
Photo 65.9
Photography 65.9
Indoors 63.2
Room 55.1

Imagga
created on 2022-01-23

people 36.2
man 33.6
happy 31.3
senior 30.9
person 30.2
male 25.5
smiling 22.4
mature 22.3
portrait 22
together 21.9
couple 21.8
looking 20
adult 19.6
face 17
blond 16.4
wife 16.1
negative 15.8
love 15.8
smile 15.7
husband 15.3
two 15.2
elderly 14.4
home 14.3
hair 14.3
women 14.2
old 13.9
lifestyle 13.7
retired 13.6
film 13.5
family 13.3
indoors 13.2
pretty 12.6
hand 12.1
dishwasher 12
sitting 12
black 12
attractive 11.9
casual 11.9
affection 11.6
retirement 11.5
eyes 11.2
blackboard 11
happiness 11
handsome 10.7
cheerful 10.6
look 10.5
human 10.5
child 10.4
desk 10.4
education 10.4
shop 10.2
fun 9.7
photographic paper 9.7
white goods 9.6
salon 9.5
mother 9.3
room 9.2
back 9.2
office 8.9
romantic 8.9
sixties 8.8
professional 8.8
60s 8.8
school 8.6
day 8.6
married 8.6
men 8.6
expression 8.5
youth 8.5
sit 8.5
business 8.5
togetherness 8.5
horizontal 8.4
daughter 8.3
camera 8.3
student 8.3
holding 8.2
outdoors 8.2
girls 8.2
gray 8.1
computer 8
kid 8
businessman 7.9
work 7.9
pensioner 7.8
older 7.8
spectator 7.7
studying 7.7
learning 7.5
care 7.4
home appliance 7.4
lady 7.3
teenager 7.3
success 7.2
childhood 7.2
romance 7.1
little 7.1

Google
created on 2022-01-23

Hairstyle 95.1
Human 89.3
Fashion 87.7
Tartan 86.9
Black-and-white 86.2
Style 84
Eyewear 81.2
Hat 79.1
Font 79
T-shirt 77.7
Art 77.6
Snapshot 74.3
Monochrome 74.3
Monochrome photography 74
Plaid 74
Event 73.6
Vintage clothing 71.1
Cooking 70.7
Room 70
Design 68.3

Microsoft
created on 2022-01-23

person 100
text 98.3
clothing 88.4
drawing 74.7
people 68.7
group 65.8
man 62.7

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 74.6%
Surprised 78.4%
Calm 13.9%
Angry 2.1%
Confused 1.7%
Happy 1.4%
Disgusted 1.4%
Fear 0.7%
Sad 0.4%

AWS Rekognition

Age 18-24
Gender Male, 98.4%
Surprised 76.8%
Calm 21.2%
Angry 0.5%
Fear 0.5%
Disgusted 0.4%
Sad 0.4%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 58%
Surprised 92.8%
Happy 5.2%
Fear 0.6%
Calm 0.6%
Disgusted 0.3%
Angry 0.2%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.7%
Calm 98.1%
Sad 0.9%
Surprised 0.5%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 66.9%
Calm 40.8%
Happy 24.3%
Sad 21.1%
Confused 5.6%
Surprised 4.5%
Fear 1.5%
Disgusted 1.5%
Angry 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Sunglasses 86.8%

Captions

Microsoft

a group of people looking at a laptop 92.6%
a group of people looking at a computer 92.2%
a group of people are looking at a laptop 88.4%

Text analysis

Amazon

a
MJIF
MJIF YT33AS ACHA
YT33AS
ACHA

Google

MJ13
YT33A2
0
MJ13 YT33A2 0