Human Generated Data

Title

Untitled (large group of women at banquet tables)
Date

c. 1945
People

Artist: Robert Burian, American active 1940s-1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19135

Human Generated Data

Title

Untitled (large group of women at banquet tables)

People

Artist: Robert Burian, American active 1940s-1950s

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Audience 98.7
Crowd 98.7
Human 98.7
Person 96.3
Person 96.2
Interior Design 94.9
Indoors 94.9
Person 94.4
Room 93.1
School 89.4
Classroom 89.4
Person 81.2
Person 74
People 73.9
Person 70.3
Theater 68.2
Auditorium 68.2
Hall 68.2
Person 66.9
Person 65.6
Speech 59.5
Person 59.3
Lecture 59.2
Seminar 56.7
Person 55.3
Person 46.4
Person 46.3

Imagga
created on 2022-03-05

mixer 89.4
electronic equipment 71.5
equipment 51
city 29.9
shoe shop 27.8
shop 24
travel 20.4
mercantile establishment 19
urban 18.3
building 18.1
architecture 17.2
tourism 13.2
town 13
place of business 12.4
cityscape 12.3
buildings 12.3
group 12.1
people 11.2
old 11.1
business 10.9
aerial 10.7
night 10.7
vacation 10.6
structure 10.4
landscape 10.4
tourist 10
silhouette 9.9
bottle 9.8
crowd 9.6
sky 9.6
street 9.2
black 9
men 8.6
roof 8.6
line 8.6
industry 8.5
industrial 8.2
transportation 8.1
tower 8.1
sea 7.8
party 7.7
modern 7.7
skyline 7.6
house 7.5
evening 7.5
church 7.4
music 7.2
hall 7.1
center 7.1

Google
created on 2022-03-05

Font 82.8
Rectangle 77.9
Urban design 75.6
Event 74.2
Crowd 74
Monochrome photography 72.8
Monochrome 71.9
Suit 63.7
City 58.2
Audience 57.1
History 54.5
Paper product 52.4
Company 51.9
Metal 50.3
Advertising 50.2

Microsoft
created on 2022-03-05

text 98.4
person 88.4
white 70.8
crowd 44.8

Face analysis

Amazon

AWS Rekognition

Age 24-34
Gender Male, 98.9%
Sad 86.1%
Confused 9.3%
Calm 2.2%
Fear 1%
Disgusted 0.4%
Happy 0.3%
Surprised 0.3%
Angry 0.3%

AWS Rekognition

Age 22-30
Gender Male, 99.3%
Happy 86.6%
Fear 8.1%
Sad 2.4%
Calm 1.4%
Surprised 0.6%
Angry 0.5%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 34-42
Gender Male, 75.5%
Happy 62.5%
Calm 25.6%
Sad 4.1%
Surprised 2%
Disgusted 1.9%
Angry 1.5%
Confused 1.4%
Fear 1%

AWS Rekognition

Age 30-40
Gender Female, 54.7%
Calm 99.8%
Happy 0.1%
Sad 0%
Disgusted 0%
Confused 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Female, 95.5%
Fear 45.1%
Calm 24.9%
Sad 21.3%
Happy 5%
Disgusted 1.3%
Confused 1%
Surprised 0.7%
Angry 0.7%

AWS Rekognition

Age 21-29
Gender Female, 86.7%
Calm 41.2%
Happy 35.3%
Sad 16.3%
Confused 2.9%
Angry 1.8%
Fear 1.1%
Surprised 0.8%
Disgusted 0.7%

AWS Rekognition

Age 29-39
Gender Male, 98.8%
Sad 30.6%
Confused 25.9%
Happy 22.1%
Calm 17.1%
Disgusted 2.4%
Angry 0.8%
Surprised 0.7%
Fear 0.4%

AWS Rekognition

Age 20-28
Gender Male, 79.6%
Calm 52.6%
Sad 45.1%
Confused 0.9%
Fear 0.4%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 9-17
Gender Male, 95.6%
Sad 82.5%
Calm 8.2%
Angry 3.4%
Confused 3%
Fear 1.2%
Happy 0.7%
Disgusted 0.6%
Surprised 0.3%

AWS Rekognition

Age 38-46
Gender Male, 99.4%
Calm 88.6%
Sad 8.5%
Confused 0.8%
Angry 0.7%
Happy 0.6%
Disgusted 0.4%
Surprised 0.3%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Female, 84.2%
Calm 88.7%
Happy 4.2%
Sad 3.2%
Fear 1.3%
Angry 0.9%
Disgusted 0.8%
Confused 0.5%
Surprised 0.4%

AWS Rekognition

Age 23-31
Gender Male, 72.4%
Calm 78.8%
Sad 17%
Angry 1.8%
Disgusted 0.7%
Happy 0.6%
Confused 0.5%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Male, 97.7%
Calm 95.2%
Sad 3.3%
Happy 0.9%
Angry 0.3%
Fear 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Male, 75.5%
Calm 90.1%
Happy 6.1%
Sad 2.2%
Confused 0.6%
Disgusted 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 1-7
Gender Male, 87.1%
Sad 56.5%
Calm 20.6%
Confused 18.7%
Happy 2.4%
Angry 0.9%
Disgusted 0.3%
Surprised 0.3%
Fear 0.3%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Calm 75.2%
Sad 22.8%
Happy 0.6%
Confused 0.5%
Fear 0.3%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 12-20
Gender Male, 85.5%
Happy 84.8%
Sad 7.2%
Calm 3.9%
Angry 1.2%
Disgusted 1.1%
Fear 0.8%
Surprised 0.5%
Confused 0.5%

AWS Rekognition

Age 41-49
Gender Male, 94.8%
Calm 59.3%
Disgusted 16.1%
Fear 9%
Angry 6.8%
Sad 3.7%
Happy 3.1%
Confused 1.3%
Surprised 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Calm 57.4%
Angry 14.8%
Happy 10.6%
Disgusted 9.5%
Sad 4.7%
Fear 1.6%
Surprised 0.8%
Confused 0.7%

AWS Rekognition

Age 28-38
Gender Male, 89.2%
Calm 77.7%
Happy 14.4%
Sad 3.3%
Confused 1.4%
Fear 0.9%
Surprised 0.9%
Angry 0.8%
Disgusted 0.7%

AWS Rekognition

Age 22-30
Gender Male, 82.9%
Calm 52.9%
Happy 37.4%
Sad 5.2%
Fear 1.5%
Angry 1.1%
Disgusted 0.8%
Confused 0.7%
Surprised 0.5%

AWS Rekognition

Age 18-24
Gender Male, 97.8%
Calm 95.9%
Sad 2.2%
Happy 0.5%
Confused 0.3%
Angry 0.3%
Fear 0.3%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 26-36
Gender Male, 99%
Sad 45.8%
Calm 22.8%
Disgusted 12.6%
Angry 9.1%
Confused 5.4%
Happy 2.3%
Surprised 1.5%
Fear 0.5%

AWS Rekognition

Age 21-29
Gender Male, 97.6%
Calm 85%
Sad 13.7%
Angry 0.6%
Fear 0.3%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 20-28
Gender Male, 82.6%
Sad 34.1%
Calm 32.4%
Happy 18.2%
Angry 5.2%
Fear 5.2%
Disgusted 2.6%
Surprised 1.6%
Confused 0.8%

AWS Rekognition

Age 39-47
Gender Female, 92.4%
Sad 57.7%
Calm 34.8%
Fear 2.8%
Confused 1.9%
Surprised 1.1%
Disgusted 0.8%
Angry 0.5%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Female, 66.3%
Calm 76.7%
Sad 22.2%
Angry 0.4%
Fear 0.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 30-40
Gender Female, 97.1%
Calm 82.5%
Happy 16.2%
Sad 0.5%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 96.1%
Calm 40.8%
Disgusted 17.2%
Angry 14.7%
Confused 7%
Happy 6.7%
Surprised 6%
Sad 4.7%
Fear 2.8%

AWS Rekognition

Age 18-24
Gender Male, 87.7%
Sad 87.2%
Calm 11.2%
Confused 0.5%
Fear 0.5%
Happy 0.2%
Disgusted 0.2%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 21-29
Gender Male, 78.4%
Calm 85.9%
Fear 3.9%
Sad 3.6%
Angry 2.5%
Disgusted 1.4%
Confused 1.1%
Happy 0.9%
Surprised 0.7%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Calm 71.2%
Sad 15.5%
Surprised 7.6%
Angry 2.2%
Confused 1.6%
Disgusted 0.8%
Fear 0.6%
Happy 0.5%

AWS Rekognition

Age 23-31
Gender Male, 83.3%
Calm 97.1%
Sad 1.5%
Fear 0.5%
Happy 0.3%
Angry 0.3%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Male, 79.3%
Calm 73.4%
Sad 21.9%
Confused 1.3%
Angry 0.9%
Fear 0.8%
Happy 0.8%
Surprised 0.5%
Disgusted 0.4%

AWS Rekognition

Age 23-31
Gender Female, 76.6%
Sad 56.5%
Calm 34.8%
Fear 2.9%
Angry 2.4%
Disgusted 1.4%
Happy 1%
Confused 0.7%
Surprised 0.3%

AWS Rekognition

Age 6-14
Gender Female, 74.7%
Sad 49.1%
Calm 22.1%
Happy 19.8%
Confused 4.8%
Fear 2.1%
Angry 1.1%
Surprised 0.5%
Disgusted 0.5%

AWS Rekognition

Age 28-38
Gender Male, 79.4%
Sad 52.4%
Calm 40.1%
Happy 3.2%
Confused 1.7%
Disgusted 1%
Fear 0.7%
Angry 0.4%
Surprised 0.3%

AWS Rekognition

Age 33-41
Gender Male, 98.5%
Sad 94.3%
Calm 4.5%
Happy 0.5%
Confused 0.4%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 29-39
Gender Male, 94.7%
Calm 91.4%
Happy 4.5%
Angry 1.1%
Sad 1%
Fear 0.8%
Confused 0.7%
Surprised 0.3%
Disgusted 0.3%

AWS Rekognition

Age 24-34
Gender Male, 99.2%
Calm 93%
Sad 4%
Happy 0.8%
Fear 0.7%
Confused 0.5%
Angry 0.4%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 30-40
Gender Female, 87.6%
Calm 76.6%
Happy 8.8%
Sad 8.2%
Disgusted 2.6%
Confused 1.4%
Surprised 0.9%
Fear 0.8%
Angry 0.6%

AWS Rekognition

Age 23-31
Gender Female, 62.7%
Calm 97.1%
Sad 1.8%
Confused 0.5%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 79.3%
Calm 50.2%
Happy 32.8%
Sad 6%
Fear 5.9%
Confused 2.1%
Disgusted 1.3%
Angry 0.9%
Surprised 0.7%

AWS Rekognition

Age 19-27
Gender Male, 83.6%
Calm 83.8%
Sad 8.3%
Fear 3.2%
Happy 1.9%
Disgusted 0.9%
Confused 0.8%
Surprised 0.7%
Angry 0.4%

AWS Rekognition

Age 26-36
Gender Male, 93%
Calm 74.4%
Happy 14.3%
Sad 8%
Fear 1.7%
Surprised 0.5%
Angry 0.4%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 18-26
Gender Male, 97.4%
Calm 98.7%
Happy 0.4%
Angry 0.3%
Confused 0.2%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Male, 92.9%
Calm 59.7%
Sad 38.9%
Disgusted 0.3%
Surprised 0.3%
Confused 0.3%
Happy 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Male, 89.8%
Calm 88.6%
Sad 4.9%
Confused 2.8%
Happy 1.4%
Surprised 1.1%
Disgusted 0.6%
Fear 0.4%
Angry 0.3%

AWS Rekognition

Age 13-21
Gender Female, 92.4%
Calm 41.8%
Sad 27.1%
Happy 18.2%
Fear 6.8%
Confused 2.1%
Surprised 1.9%
Angry 1.1%
Disgusted 1%

AWS Rekognition

Age 9-17
Gender Male, 93.9%
Calm 56.9%
Sad 21.7%
Happy 11.9%
Fear 6.2%
Confused 1.3%
Disgusted 0.8%
Angry 0.7%
Surprised 0.4%

AWS Rekognition

Age 20-28
Gender Male, 76%
Calm 34.2%
Fear 25%
Sad 24.3%
Happy 7.5%
Disgusted 3.8%
Surprised 2.4%
Angry 2%
Confused 0.8%

AWS Rekognition

Age 21-29
Gender Male, 64.4%
Calm 53.7%
Sad 38.4%
Angry 2%
Confused 1.8%
Fear 1.3%
Happy 1.2%
Disgusted 0.9%
Surprised 0.8%

AWS Rekognition

Age 19-27
Gender Male, 58%
Calm 87.2%
Sad 12.4%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 50.2%
Sad 52.9%
Calm 38.8%
Happy 2.4%
Confused 2%
Fear 1.5%
Surprised 1%
Angry 0.8%
Disgusted 0.6%

AWS Rekognition

Age 18-24
Gender Female, 74.8%
Calm 89.4%
Sad 7.5%
Confused 0.7%
Happy 0.6%
Fear 0.6%
Surprised 0.5%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 30-40
Gender Male, 68.7%
Calm 57%
Happy 25.9%
Sad 11.3%
Disgusted 2.4%
Confused 1.4%
Fear 0.7%
Surprised 0.6%
Angry 0.6%

AWS Rekognition

Age 18-26
Gender Female, 62.6%
Calm 95.6%
Happy 2.4%
Sad 1.4%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%
Fear 0%
Surprised 0%

AWS Rekognition

Age 12-20
Gender Male, 72.3%
Calm 56.4%
Angry 19.6%
Sad 9.7%
Fear 5.9%
Happy 3.6%
Confused 2.5%
Disgusted 1.3%
Surprised 1%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Sad 87.8%
Calm 9.8%
Fear 0.8%
Confused 0.5%
Disgusted 0.4%
Happy 0.3%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 18-24
Gender Male, 89.8%
Calm 77.6%
Happy 11%
Sad 7.9%
Angry 1.2%
Confused 0.9%
Disgusted 0.7%
Fear 0.6%
Surprised 0.3%

Feature analysis

Amazon

Person 96.3%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 90.5%
a group of people standing in front of a crowd 90.4%
a group of people posing for a photo in front of a crowd 90.3%

Text analysis

Amazon

a
YT3RAS
MJIA YT3RAS
MJIA
IPP - 2

Google

LLILTH
LLILTH