Human Generated Data

Title

Untitled (man playing piano with Santa Claus and group of children)

Date

1955

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18225

Human Generated Data

Title

Untitled (man playing piano with Santa Claus and group of children)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Person 99.3
Human 99.3
Person 99.2
Person 98.4
Person 98.4
Person 97.6
Person 97.5
Person 94.7
Person 94.4
Wood 93.4
Plywood 91.6
Apparel 86
Clothing 86
Person 85.4
Person 84.3
Person 76.4
Carpenter 72.7
Building 72.3
Person 70.1
People 60.9
Person 58.7
Crowd 57.7
Overcoat 55.6
Suit 55.6
Coat 55.6

Imagga
created on 2022-03-04

man 23.6
people 18.9
industry 16.2
men 15.4
person 15
worker 14.2
male 14.2
sword 13.7
weapon 13.4
industrial 12.7
work 12.5
metal 12.1
mask 11.9
adult 11.8
black 11.5
factory 11.2
old 11.1
city 10.8
labor 10.7
urban 10.5
building 9.7
working 9.7
life 9.5
dirty 9
builder 8.9
sitting 8.6
construction 8.5
room 8.5
power 8.4
machinist 8.3
steel 7.9
lifestyle 7.9
carpenter 7.9
house 7.5
hospital 7.4
street 7.4
world 7.1
portrait 7.1
to 7.1
table 7

Google
created on 2022-03-04

Microsoft
created on 2022-03-04

text 97.6
person 90.5
clothing 88
black and white 86.5
ship 65.1
firefighter 56.8
man 51.5

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 97%
Sad 73.4%
Calm 18.6%
Happy 3.3%
Confused 1.6%
Disgusted 1.4%
Angry 0.8%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 30-40
Gender Male, 97.9%
Calm 97.9%
Sad 0.7%
Fear 0.6%
Surprised 0.3%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 18-26
Gender Male, 81%
Calm 79%
Sad 20.1%
Angry 0.8%
Confused 0.1%
Disgusted 0%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 60.1%
Calm 81.7%
Happy 10.3%
Fear 2.8%
Sad 2.6%
Disgusted 1%
Confused 0.7%
Surprised 0.6%
Angry 0.3%

AWS Rekognition

Age 25-35
Gender Male, 95.4%
Calm 99.8%
Angry 0.1%
Fear 0%
Surprised 0%
Sad 0%
Happy 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Male, 99.2%
Calm 99.2%
Happy 0.4%
Sad 0.2%
Fear 0.1%
Disgusted 0%
Confused 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 34-42
Gender Male, 55.9%
Calm 94.1%
Sad 5.1%
Confused 0.2%
Happy 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Female, 75.5%
Calm 99.9%
Sad 0%
Surprised 0%
Angry 0%
Happy 0%
Disgusted 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people sitting at a table 70%
a group of people sitting around a table 69.7%

Text analysis

Google

MJI7-- YT37A 2 - - NAGOX
NAGOX
-
MJI7--
YT37A
2