Human Generated Data

Title

Untitled (band practicing in gymnasium)
Date

1943
People

Artist: John Deusing, American active 1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1736

Human Generated Data

Title

Untitled (band practicing in gymnasium)

People

Artist: John Deusing, American active 1940s

Date

1943

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Indoors 99.8
Room 99.8
Crowd 99.2
Human 99.2
Person 97.7
Theater 97.6
Person 97.2
Person 95.1
Person 89.8
Concert 89.8
Marching 88.6
Musical Instrument 85.9
Person 85.5
Person 84.5
Musician 84.5
Housing 83.8
Building 83.8
Orchestra 83.8
Person 83.5
Person 82
Chair 81.2
Furniture 81.2
Person 80.4
Music Band 79.6
Person 79.2
Person 78.7
Auditorium 78.2
Hall 78.2
Person 77.8
Person 77.1
Person 73.8
People 73.6
Person 71.7
Interior Design 68.9
Person 63.3
Person 62
Classroom 58.5
School 58.5
Audience 57.8
Villa 55.3
House 55.3
Person 50.5

Imagga
created on 2021-12-14

classroom 100
room 91.4
building 20.5
group 17.7
travel 17.6
city 17.4
people 17.3
crowd 17.3
urban 13.1
restaurant 12.6
walking 12.3
landscape 11.9
chair 11.8
architecture 11.7
transportation 11.6
cafeteria 11.3
life 10.6
animal 10.3
tourism 9.9
vacation 9.8
summer 9.6
men 9.4
day 9.4
water 9.3
hall 9.3
tourist 9.1
sky 8.9
new 8.9
interior 8.8
station 8.7
sea 8.6
wall 8.5
business 8.5
beach 8.4
structure 8.4
outdoor 8.4
bird 8.4
street 8.3
outdoors 8.2
man 8.1
old 7.7
house 7.5
south 7.5
resort 7.5
ocean 7.5
shore 7.4
many 7.4
light 7.3
unicycle 7.3
speed 7.3
transport 7.3
coast 7.2
seat 7.1
scenic 7
modern 7

Google
created on 2021-12-14

Photograph 94.2
Snapshot 74.3
Crew 74.3
Event 73
Monochrome 70.2
Monochrome photography 65.4
Symmetry 65.2
Room 64.2
Entertainment 63.6
Class 62.6
Stock photography 62.1
Team 61.6
History 60.5
Uniform 59.5
Hall 58.1
Folk instrument 58.1
Troop 56.7
Crowd 55.7
Metal 54
Military organization 51.2

Microsoft
created on 2021-12-14

person 97.3
text 95.9
group 77.6
black 72.8
white 72.6
people 67.5
horse 22
several 15.9

Face analysis

Amazon

Google

AWS Rekognition

Age 52-70
Gender Female, 72.4%
Calm 85.7%
Happy 10.5%
Sad 2%
Surprised 0.7%
Confused 0.5%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 27-43
Gender Female, 67.7%
Happy 91.3%
Calm 5.8%
Angry 1.2%
Sad 0.7%
Surprised 0.4%
Confused 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 28-44
Gender Male, 91.9%
Angry 64.3%
Calm 10.6%
Surprised 10.4%
Sad 5.5%
Confused 3.2%
Fear 3.2%
Happy 1.9%
Disgusted 0.8%

AWS Rekognition

Age 18-30
Gender Female, 85.2%
Calm 45.6%
Happy 33.5%
Sad 16.1%
Confused 1.2%
Surprised 1.2%
Angry 1.1%
Fear 0.7%
Disgusted 0.5%

AWS Rekognition

Age 50-68
Gender Male, 59%
Happy 70%
Calm 24.5%
Confused 2.3%
Sad 1.4%
Surprised 0.8%
Angry 0.5%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 27-43
Gender Female, 61.2%
Calm 88.8%
Happy 8.6%
Sad 1.6%
Surprised 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 28-44
Gender Male, 63.6%
Calm 58.9%
Happy 28.5%
Sad 6.9%
Surprised 1.6%
Confused 1.3%
Angry 1.1%
Fear 1%
Disgusted 0.7%

AWS Rekognition

Age 51-69
Gender Female, 85.5%
Calm 59.1%
Happy 33%
Surprised 2.8%
Sad 1.5%
Confused 1%
Fear 1%
Disgusted 0.8%
Angry 0.7%

AWS Rekognition

Age 47-65
Gender Male, 61.8%
Happy 35.1%
Sad 30%
Calm 26.5%
Confused 3.5%
Angry 3.2%
Surprised 0.6%
Fear 0.6%
Disgusted 0.4%

AWS Rekognition

Age 35-51
Gender Male, 86.4%
Calm 77.8%
Happy 13.7%
Sad 4.9%
Angry 2.6%
Confused 0.5%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 21-33
Gender Male, 88.7%
Happy 82.4%
Calm 9.6%
Surprised 3.3%
Sad 3%
Fear 0.6%
Confused 0.5%
Angry 0.4%
Disgusted 0.2%

AWS Rekognition

Age 28-44
Gender Female, 63.9%
Calm 62.5%
Sad 22.9%
Happy 8.2%
Surprised 2%
Fear 2%
Angry 1.3%
Confused 0.9%
Disgusted 0.3%

AWS Rekognition

Age 30-46
Gender Male, 63.1%
Calm 57.7%
Sad 23%
Surprised 8.7%
Angry 3.5%
Confused 3.1%
Fear 1.9%
Happy 1.9%
Disgusted 0.3%

AWS Rekognition

Age 35-51
Gender Female, 67.5%
Calm 31.1%
Sad 26.8%
Happy 14.8%
Confused 14.6%
Surprised 5.1%
Angry 4.2%
Disgusted 1.9%
Fear 1.5%

AWS Rekognition

Age 21-33
Gender Male, 85.4%
Calm 90.8%
Sad 3.9%
Angry 1.8%
Happy 1.3%
Surprised 0.7%
Confused 0.5%
Disgusted 0.5%
Fear 0.5%

AWS Rekognition

Age 39-57
Gender Male, 66.2%
Calm 61.6%
Surprised 24%
Angry 6.5%
Sad 3.8%
Confused 2.5%
Happy 0.9%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 45-63
Gender Male, 70.7%
Sad 48.8%
Calm 40.3%
Happy 3.4%
Angry 3.2%
Fear 2.3%
Confused 1.2%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 34-50
Gender Male, 79.7%
Sad 72.5%
Calm 11.5%
Angry 10.5%
Confused 3.2%
Disgusted 0.9%
Surprised 0.5%
Fear 0.5%
Happy 0.4%

AWS Rekognition

Age 23-35
Gender Female, 63.6%
Calm 84.5%
Happy 7.4%
Surprised 2.2%
Sad 2%
Angry 1.5%
Confused 1.1%
Fear 0.9%
Disgusted 0.4%

AWS Rekognition

Age 25-39
Gender Male, 56%
Calm 41.1%
Happy 25.8%
Sad 19.2%
Angry 8.7%
Fear 2.5%
Confused 1.4%
Surprised 0.9%
Disgusted 0.3%

AWS Rekognition

Age 51-69
Gender Male, 79%
Calm 46.9%
Sad 17.3%
Angry 14.8%
Confused 8.1%
Fear 4.3%
Happy 4.1%
Surprised 3.3%
Disgusted 1.2%

AWS Rekognition

Age 38-56
Gender Female, 74.2%
Calm 86.4%
Sad 11%
Happy 2.2%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 10-20
Gender Female, 55.8%
Calm 51.6%
Sad 19.5%
Surprised 11.9%
Angry 6.1%
Confused 4.8%
Happy 3%
Disgusted 1.6%
Fear 1.6%

AWS Rekognition

Age 51-69
Gender Male, 82.4%
Surprised 92.9%
Calm 2.1%
Fear 1.4%
Angry 1.3%
Confused 1%
Happy 0.5%
Sad 0.5%
Disgusted 0.2%

AWS Rekognition

Age 48-66
Gender Female, 72.2%
Calm 76.2%
Sad 15.3%
Happy 4%
Angry 2.6%
Confused 1.2%
Surprised 0.4%
Disgusted 0.2%
Fear 0%

AWS Rekognition

Age 26-42
Gender Male, 69.6%
Calm 62.6%
Sad 15.5%
Happy 8.6%
Angry 4.3%
Confused 4.2%
Fear 3%
Surprised 1.2%
Disgusted 0.5%

AWS Rekognition

Age 51-69
Gender Female, 56.2%
Calm 45.7%
Sad 42.6%
Happy 6.1%
Confused 3.9%
Surprised 0.7%
Angry 0.7%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 25-39
Gender Female, 97.2%
Sad 46.7%
Calm 39.1%
Surprised 8.9%
Happy 3.1%
Confused 1.1%
Angry 0.9%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Female, 63.4%
Calm 77.1%
Happy 14.8%
Angry 4.1%
Sad 2.1%
Confused 1%
Surprised 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 36-52
Gender Male, 87.4%
Surprised 32.2%
Calm 26.6%
Angry 13.9%
Fear 13.8%
Confused 5.1%
Disgusted 4.4%
Happy 2.9%
Sad 1.1%

AWS Rekognition

Age 29-45
Gender Male, 93.8%
Happy 54.8%
Calm 27.3%
Angry 12.2%
Sad 3.7%
Confused 1.1%
Surprised 0.5%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 48-66
Gender Female, 80.8%
Calm 79.3%
Sad 12.3%
Happy 8.2%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 33-49
Gender Male, 71.5%
Calm 62%
Happy 17.5%
Sad 17.5%
Angry 1.6%
Confused 0.8%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 50-68
Gender Female, 87.8%
Calm 84.2%
Sad 12.2%
Happy 1.8%
Confused 0.6%
Surprised 0.6%
Fear 0.3%
Angry 0.2%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%

Captions

Microsoft

a group of people riding on the back of a horse 89.2%
a group of people standing next to a horse 89.1%
a group of people standing on top of a horse 89%

Text analysis

Amazon

45