Human Generated Data

Title

Untitled (group of soldier, Artillery Division victory party)

Date

1945

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22290

Human Generated Data

Title

Untitled (group of soldier, Artillery Division victory party)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 98.8
Human 98.8
Person 98.7
Person 97.8
Person 97.4
Person 95.4
Person 94.4
Person 94.3
Person 92.1
Person 91.9
Apparel 90.8
Clothing 90.8
Person 90.5
Indoors 86.2
Person 85.3
Person 85.1
Furniture 84.1
Person 84
Person 82
Room 81.4
Face 74.7
Crowd 71.8
Shorts 70.9
Dress 70
Floor 69.8
Chair 68.3
Suit 68.1
Coat 68.1
Overcoat 68.1
Person 66.8
People 66.1
Photography 66
Photo 66
Audience 66
Portrait 65.5
Person 64.4
Person 63.4
Female 62.5
Art 62.2
Bed 61.3
Kid 60.4
Child 60.4
Flooring 59.5
Play 58.9
Bedroom 57.8
Drawing 57.3
Screen 55.6
Electronics 55.6
Person 45.3

Imagga
created on 2022-03-11

room 58.5
classroom 44.4
people 26.8
interior 26.5
teacher 24.4
chair 23.7
person 20.8
table 20.8
home 19.1
house 18.4
adult 17.5
man 17.5
indoors 16.7
furniture 16.2
educator 16.1
light 15.4
window 13.9
party 13.7
indoor 13.7
music 13.6
women 13.4
dance 13.1
group 12.9
wood 12.5
night 12.4
silhouette 12.4
professional 12
stage 11.8
male 11.3
couple 11.3
luxury 11.1
blackboard 10.8
concert 10.7
modern 10.5
hotel 10.5
lamp 10.5
hospital 10.4
sitting 10.3
design 10.1
couch 9.7
dancing 9.6
dancer 9.6
body 9.6
desk 9.4
lifestyle 9.4
glass 9.3
floor 9.3
classic 9.3
relax 9.3
elegance 9.2
disco 9.2
entertainment 9.2
inside 9.2
business 9.1
attractive 9.1
fun 9
student 8.9
decor 8.8
chairs 8.8
crowd 8.6
men 8.6
elegant 8.6
club 8.5
fashion 8.3
happy 8.1
office 8
bedroom 8
outfit 8
celebration 8
love 7.9
black 7.8
seat 7.8
sofa 7.7
flower 7.7
comfortable 7.6
relaxation 7.5
performer 7.5
leisure 7.5
life 7.3
dress 7.2
curtain 7.1
work 7.1
architecture 7
together 7

Google
created on 2022-03-11

Black 89.8
Style 83.9
Black-and-white 83
Art 82.6
Monochrome 75.1
Monochrome photography 74.2
Vintage clothing 73.7
Event 72.2
Classic 71.7
Illustration 70.6
Suit 68.1
Room 68
Team 67.5
Font 67
History 63.8
Class 63.8
Fun 63.7
Crowd 63.4
Visual arts 62.4
Crew 60.7

Microsoft
created on 2022-03-11

wall 95.3
ceiling 94.8
indoor 91.6
text 90.2
person 85.1
clothing 79.2
standing 78.9
people 65.9
man 60.1
room 52.4

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 98.2%
Sad 98.7%
Calm 0.6%
Confused 0.4%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 96.4%
Sad 51.7%
Disgusted 12.4%
Happy 9.3%
Angry 9.1%
Fear 7.7%
Calm 7.4%
Surprised 1.6%
Confused 0.8%

AWS Rekognition

Age 45-51
Gender Male, 98.1%
Sad 60.7%
Calm 14.9%
Happy 13.4%
Fear 5.9%
Confused 2.3%
Surprised 1%
Disgusted 0.9%
Angry 0.9%

AWS Rekognition

Age 28-38
Gender Female, 77.1%
Calm 68%
Fear 5.8%
Sad 5.5%
Confused 5.4%
Disgusted 5.4%
Angry 4.8%
Happy 3.5%
Surprised 1.7%

AWS Rekognition

Age 20-28
Gender Female, 60.5%
Sad 79.4%
Calm 12.1%
Fear 4.7%
Confused 1.2%
Angry 1%
Happy 0.6%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 16-22
Gender Male, 52.9%
Calm 71.1%
Sad 12.6%
Confused 5.1%
Happy 4.1%
Fear 3.8%
Disgusted 1.5%
Angry 1.1%
Surprised 0.7%

AWS Rekognition

Age 30-40
Gender Male, 89.1%
Calm 98%
Sad 0.8%
Confused 0.4%
Happy 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 35-43
Gender Male, 89.6%
Calm 58.6%
Sad 31.4%
Happy 3.8%
Angry 2.6%
Disgusted 1.5%
Confused 1.1%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 35-43
Gender Male, 99.7%
Sad 92.6%
Happy 3%
Confused 2.4%
Calm 1.2%
Fear 0.3%
Angry 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 16-24
Gender Male, 99.5%
Calm 42.1%
Happy 29.5%
Sad 14.4%
Angry 5.5%
Confused 2.7%
Surprised 2.4%
Disgusted 2.2%
Fear 1.1%

AWS Rekognition

Age 35-43
Gender Male, 86.2%
Sad 69.5%
Calm 25.9%
Fear 1.5%
Confused 1.1%
Happy 0.9%
Angry 0.5%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Sad 98.8%
Disgusted 0.4%
Angry 0.2%
Fear 0.2%
Confused 0.1%
Calm 0.1%
Happy 0.1%
Surprised 0%

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Sad 83.5%
Happy 5.7%
Calm 3.9%
Angry 2.3%
Confused 2%
Disgusted 1.7%
Surprised 0.6%
Fear 0.3%

AWS Rekognition

Age 43-51
Gender Male, 99%
Sad 76.5%
Fear 8.1%
Disgusted 7.1%
Confused 2.7%
Angry 1.9%
Calm 1.8%
Surprised 1.3%
Happy 0.6%

AWS Rekognition

Age 36-44
Gender Female, 70.6%
Happy 49.7%
Surprised 17.9%
Calm 17.1%
Sad 9.8%
Angry 1.9%
Disgusted 1.5%
Confused 1.4%
Fear 0.8%

AWS Rekognition

Age 40-48
Gender Female, 85.7%
Happy 37.9%
Calm 17.7%
Confused 16.1%
Sad 13.1%
Disgusted 9.2%
Angry 3.1%
Fear 1.4%
Surprised 1.4%

AWS Rekognition

Age 27-37
Gender Male, 98.7%
Sad 97.9%
Calm 1.4%
Confused 0.3%
Surprised 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.7%
Sad 75.5%
Confused 16%
Calm 3.4%
Happy 2.6%
Angry 0.7%
Disgusted 0.7%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 43-51
Gender Male, 99.7%
Calm 93.3%
Confused 3.4%
Sad 1.5%
Happy 0.8%
Disgusted 0.4%
Angry 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 98%
Sad 96.2%
Calm 1.6%
Angry 0.8%
Fear 0.4%
Confused 0.4%
Happy 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 23-31
Gender Female, 94.8%
Sad 46.9%
Happy 21%
Fear 9.5%
Angry 6.6%
Confused 5.9%
Disgusted 4.4%
Calm 3.3%
Surprised 2.5%

AWS Rekognition

Age 26-36
Gender Male, 74.6%
Sad 58.6%
Calm 32.8%
Angry 6%
Confused 0.8%
Disgusted 0.6%
Fear 0.4%
Happy 0.4%
Surprised 0.3%

AWS Rekognition

Age 22-30
Gender Female, 98.3%
Sad 79.1%
Calm 6.6%
Happy 4.6%
Confused 4.2%
Angry 3.6%
Disgusted 0.7%
Fear 0.7%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a group of people standing in a room 95.8%
a group of people in a room 95.7%
a group of people that are standing in a room 93.2%

Text analysis

Amazon

VICTORY
PARTY
ARTILLERY
DE
TO
KODEK-2VLEIA

Google

AT VICTORY
VICTORY
AT