Human Generated Data

Title

Untitled (Reenactment of the First Public Demonstration of the Surgical Use of Ether)
Date

1847
People

Artist: Southworth & Hawes, American active 1843-1863
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Massachusetts General Hospital Archives and Special Collections, 3.1979

Human Generated Data

Title

Untitled (Reenactment of the First Public Demonstration of the Surgical Use of Ether)

People

Artist: Southworth & Hawes, American active 1843-1863

Date

1847

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Massachusetts General Hospital Archives and Special Collections, 3.1979

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Human 98.4
Person 98.4
Person 97.7
Interior Design 97.5
Indoors 97.5
Person 96.5
Person 95
Room 91
Person 89.5
Person 88.5
Helmet 87.3
Clothing 87.3
Apparel 87.3
Person 84.9
Person 84.9
Helmet 83.7
Person 76.4
Person 75.3
Crowd 72.5
Face 71.4
Helmet 68
Coat 64.7
People 64.3
Theater 62.4
Overcoat 59.3
Suit 58.8
Officer 57.3
Military 57.3
Military Uniform 57.3
Sailor Suit 56.7
Audience 56
Performer 55.2

Clarifai
created on 2023-10-29

people 99.8
adult 98.3
man 98.3
woman 98.1
child 97.1
portrait 96.1
wear 93.8
group 93.3
boy 90.4
exploration 90
art 89.7
group together 86.2
moon 85
music 85
school 84.9
one 84.3
transportation system 84.2
military 83.3
war 83.1
vehicle 82.5

Imagga
created on 2022-06-25

graffito 32.6
blackboard 26.3
decoration 24.9
chalk 20.7
black 18.8
grunge 16.2
texture 16
screen 15.5
water 15.3
background 14.7
art 14.4
education 13.8
chalkboard 13.7
symbol 13.5
bathing cap 13.2
pattern 13
board 12.2
school 11.7
teacher 11.5
night 11.5
information 11.5
learning 11.3
cold 11.2
dark 10.8
classroom 10.7
cap 10.4
learn 10.4
study 10.2
display 10.2
silhouette 9.9
lesson 9.7
splash 9.7
sea 9.6
class 9.6
text 9.6
college 9.5
ocean 9.4
youth 9.4
space 9.3
wet 8.9
elementary 8.8
teaching 8.8
headdress 8.7
clothing 8.6
writing 8.5
design 8.4
horizontal 8.4
old 8.4
color 8.3
student 8.1
dirty 8.1
digital 8.1
material 8
graphic 8
planet 7.9
primary 7.8
language 7.8
studying 7.7
stars 7.5
vintage 7.4
light 7.3
cemetery 7.3
border 7.2
holiday 7.2
childhood 7.2
work 7.1
sky 7

Google
created on 2022-06-25

Black 89.7
Coat 89.6
Sleeve 86.5
Rectangle 84.4
Suit 80.9
Font 76.7
Electronic device 75.9
Collar 72.3
Event 63.8
Metal 63.2
History 62.5
Computer accessory 60
Vintage clothing 59.8
Circle 58.4
Square 52.2
Blazer 51.9

Microsoft
created on 2022-06-25

text 97.8
clothing 95.9
person 95.5
man 93
human face 91.2
black 68.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Calm 77.6%
Sad 21.9%
Surprised 6.4%
Fear 6%
Confused 2.4%
Angry 0.9%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 71.7%
Confused 8.7%
Angry 7.6%
Surprised 7.3%
Sad 6.6%
Fear 6.1%
Disgusted 0.7%
Happy 0.6%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Sad 99.3%
Calm 29.2%
Surprised 6.5%
Fear 6.1%
Confused 3.7%
Angry 3.4%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Angry 100%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Confused 0%
Calm 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 23-31
Gender Male, 98.6%
Sad 100%
Surprised 6.4%
Fear 6%
Calm 5.2%
Confused 2%
Angry 0.4%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Sad 99.8%
Calm 24.3%
Surprised 6.6%
Fear 6.1%
Confused 2.5%
Angry 1.4%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 85.3%
Sad 10%
Surprised 6.4%
Fear 6.1%
Confused 0.9%
Angry 0.7%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 51-59
Gender Male, 50.9%
Sad 99.8%
Calm 25.3%
Surprised 6.4%
Fear 6%
Angry 3%
Confused 1.1%
Disgusted 0.6%
Happy 0.2%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Angry 3%
Calm 2.5%
Confused 0.2%
Disgusted 0.2%
Happy 0%

AWS Rekognition

Age 25-35
Gender Male, 99.6%
Sad 100%
Calm 12.9%
Surprised 6.6%
Fear 6.1%
Confused 1%
Angry 0.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 50-58
Gender Male, 99.7%
Angry 85.7%
Calm 7%
Surprised 6.7%
Fear 6.4%
Sad 2.9%
Confused 1.1%
Disgusted 0.9%
Happy 0.8%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Helmet 87.3%

Categories

Imagga

paintings art 71.5%
food drinks 14.3%
people portraits 7.1%
events parties 3.4%
interior objects 2.6%

Captions

Microsoft

an old photo of a person 40.7%