Human Generated Data

Title

Untitled (Civil Works Administration demonstration, United States Customs' House, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4250

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, United States Customs' House, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4250

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Crowd 100
Human 100
Audience 100
Interior Design 96.4
Indoors 96.4
Person 88.4
Person 79.7
Person 74.8
Person 71.3
Person 70.9
Person 68.6
Speech 68.3
People 63.7
Person 63.2
Person 62.1
Person 60.6
Lecture 60.2
Advertisement 55.8
Head 55.5
Person 43.1

Clarifai
created on 2023-10-25

people 99.9
many 99.5
group 99.2
war 97.9
military 97.3
adult 97
soldier 96.5
group together 94.7
man 93.1
crowd 92.3
train 91.2
uniform 90.2
audience 89.5
administration 88.3
leader 88
wear 87.4
spectator 86.6
transportation system 84.5
army 83.7
child 83.5

Imagga
created on 2022-01-08

cinema 76.6
theater 62.8
classroom 51.4
building 44.5
room 41.8
structure 31.1
group 18.5
business 18.2
people 16.7
hall 14.3
man 14.1
travel 14.1
work 13.3
computer 13.2
businessman 12.3
meeting 12.2
laptop 12.1
male 12
architecture 11.7
event 11.1
person 11.1
city 10.8
crowd 10.5
office 10.4
entrepreneur 10.1
indoor 10
center 10
corporate 9.4
men 9.4
tourism 9.1
audience 8.8
keyboard 8.4
communication 8.4
landscape 8.2
businesswoman 8.2
team 8
professional 7.9
university 7.8
student 7.7
spectator 7.7
old 7.6
sky 7.6
screen 7.5
row 7.4
bird 7.4
chair 7.4
executive 7.4
new 7.3
color 7.2
celebration 7.2
animal 7.1
interior 7.1
working 7.1
sea 7

Google
created on 2022-01-08

Headgear 81.7
Font 77.6
Art 77.3
Crew 73.1
Event 70.1
Crowd 68.6
Team 66.7
Monochrome 65.2
Monochrome photography 64.4
History 63.7
Room 60.8
Collection 59.1
Visual arts 56.4
Audience 55.7
Photo caption 51.3

Microsoft
created on 2022-01-08

person 91
clothing 90.8
man 89
human face 76
crowd 33.6
auditorium 16.7
conference room 10.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 78.3%
Calm 96.7%
Confused 2.4%
Sad 0.4%
Surprised 0.3%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 21-29
Gender Male, 94.1%
Calm 95.4%
Sad 2.9%
Confused 0.8%
Surprised 0.3%
Angry 0.2%
Fear 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 92.1%
Calm 82.8%
Sad 15.7%
Angry 0.5%
Fear 0.2%
Confused 0.2%
Disgusted 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 95.5%
Sad 50.7%
Calm 46.8%
Confused 1.1%
Angry 0.4%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 96.3%
Calm 90.3%
Confused 3.6%
Surprised 2%
Sad 1.6%
Angry 0.8%
Disgusted 0.8%
Happy 0.5%
Fear 0.4%

AWS Rekognition

Age 27-37
Gender Male, 88.3%
Calm 91.5%
Sad 4%
Surprised 1.8%
Angry 1.2%
Confused 0.7%
Fear 0.4%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 25-35
Gender Male, 97.2%
Sad 23.9%
Confused 22.2%
Happy 21.2%
Calm 10.7%
Angry 8.1%
Surprised 6.2%
Fear 4.6%
Disgusted 3.1%

AWS Rekognition

Age 33-41
Gender Male, 63.9%
Calm 61.6%
Confused 11.5%
Sad 9.4%
Surprised 7.2%
Happy 4.6%
Fear 2.1%
Angry 2.1%
Disgusted 1.6%

AWS Rekognition

Age 21-29
Gender Male, 98.3%
Calm 95.6%
Angry 1.8%
Fear 1.2%
Sad 1%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 36-44
Gender Male, 99.2%
Happy 97.7%
Calm 1.3%
Sad 0.3%
Disgusted 0.2%
Surprised 0.2%
Angry 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 82.8%
Angry 14.9%
Sad 0.8%
Disgusted 0.4%
Confused 0.3%
Happy 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 52.6%
Calm 95.8%
Fear 1.6%
Sad 1.1%
Surprised 0.5%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 98.8%
Surprised 0.5%
Disgusted 0.2%
Sad 0.1%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.3%
Happy 27.3%
Sad 21.9%
Calm 20.7%
Angry 10.1%
Surprised 7.2%
Confused 6.6%
Disgusted 3.2%
Fear 3%

AWS Rekognition

Age 19-27
Gender Male, 99.7%
Calm 92.8%
Angry 3.4%
Sad 2.2%
Confused 0.9%
Surprised 0.3%
Fear 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 39-47
Gender Male, 98.7%
Surprised 27.4%
Sad 20.6%
Confused 16.9%
Calm 15.3%
Disgusted 6.1%
Angry 5.8%
Fear 4.1%
Happy 3.7%

AWS Rekognition

Age 39-47
Gender Male, 99.6%
Calm 85.9%
Sad 5.5%
Angry 3.3%
Surprised 2.2%
Confused 0.9%
Fear 0.8%
Disgusted 0.8%
Happy 0.6%

AWS Rekognition

Age 48-54
Gender Male, 98.4%
Sad 56.7%
Calm 18.6%
Happy 16.1%
Angry 5.7%
Confused 1%
Disgusted 0.9%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 33-41
Gender Male, 94.3%
Sad 94.8%
Calm 4.4%
Angry 0.6%
Confused 0.1%
Happy 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 75.3%
Angry 6.4%
Sad 5.7%
Happy 3.3%
Surprised 3.2%
Fear 2.9%
Disgusted 2.4%
Confused 0.8%

AWS Rekognition

Age 19-27
Gender Male, 98.6%
Calm 99.4%
Sad 0.3%
Angry 0.1%
Confused 0.1%
Fear 0%
Surprised 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 35-43
Gender Male, 97.5%
Calm 69.9%
Sad 11.4%
Happy 5.9%
Surprised 4.3%
Angry 3.1%
Disgusted 2.2%
Fear 1.6%
Confused 1.5%

AWS Rekognition

Age 37-45
Gender Male, 90.3%
Calm 46.2%
Sad 40.3%
Happy 4%
Confused 3.6%
Angry 3%
Disgusted 1.1%
Surprised 0.9%
Fear 0.9%

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 98%
Surprised 0.9%
Sad 0.4%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Female, 98.2%
Calm 59.8%
Sad 25.7%
Surprised 4.6%
Fear 4.1%
Confused 2.6%
Disgusted 1.4%
Angry 1.2%
Happy 0.6%

AWS Rekognition

Age 20-28
Gender Female, 53.4%
Sad 89.1%
Calm 8.1%
Angry 0.8%
Fear 0.7%
Confused 0.5%
Disgusted 0.3%
Surprised 0.3%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Male, 93.5%
Calm 40.7%
Fear 31.9%
Happy 12.6%
Angry 5.1%
Sad 4.5%
Surprised 3.5%
Confused 1%
Disgusted 0.7%

AWS Rekognition

Age 35-43
Gender Male, 98.9%
Calm 65.4%
Fear 14.5%
Sad 11.2%
Disgusted 3.3%
Surprised 2.8%
Confused 1.2%
Angry 0.9%
Happy 0.7%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 87.3%
Angry 7.4%
Sad 2.1%
Surprised 1.6%
Confused 0.5%
Fear 0.5%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Surprised 65.4%
Confused 7.9%
Fear 7.8%
Disgusted 6%
Happy 5.1%
Calm 3.6%
Angry 2.1%
Sad 2%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Calm 69.5%
Sad 25.5%
Angry 1.8%
Confused 1.3%
Surprised 0.7%
Happy 0.5%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 92.9%
Sad 2.9%
Happy 2.2%
Disgusted 0.6%
Surprised 0.5%
Confused 0.4%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 14-22
Gender Female, 88.2%
Calm 72.9%
Sad 16.3%
Fear 5.1%
Angry 2.3%
Happy 1.2%
Disgusted 0.8%
Surprised 0.8%
Confused 0.6%

AWS Rekognition

Age 4-10
Gender Male, 84%
Calm 98.1%
Happy 0.7%
Fear 0.4%
Sad 0.3%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 14-22
Gender Male, 91.8%
Calm 92.8%
Happy 4.8%
Angry 0.9%
Sad 0.8%
Disgusted 0.3%
Confused 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.5%
Calm 50.4%
Fear 32.5%
Sad 6.5%
Angry 3.8%
Disgusted 2.6%
Surprised 2%
Happy 1.3%
Confused 1%

AWS Rekognition

Age 48-54
Gender Female, 76.6%
Calm 38.3%
Happy 37.2%
Sad 6.5%
Surprised 6.3%
Angry 3.7%
Disgusted 3.1%
Confused 2.5%
Fear 2.4%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 55.5%
Surprised 14.6%
Angry 12%
Sad 8.7%
Disgusted 4.1%
Fear 3.6%
Happy 0.9%
Confused 0.6%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 98.5%
Sad 0.9%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 97%
Sad 1.6%
Angry 0.5%
Happy 0.3%
Surprised 0.2%
Confused 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.5%
Calm 95.3%
Surprised 1.3%
Fear 1.1%
Sad 1%
Angry 0.5%
Disgusted 0.4%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 10-18
Gender Male, 99.7%
Calm 85.7%
Angry 9.5%
Sad 2.1%
Confused 1.4%
Surprised 0.4%
Disgusted 0.3%
Happy 0.3%
Fear 0.3%

AWS Rekognition

Age 20-28
Gender Male, 99.3%
Calm 79.1%
Sad 7.3%
Angry 4.4%
Happy 4.3%
Disgusted 1.7%
Confused 1.5%
Fear 1.2%
Surprised 0.5%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 42.3%
Angry 19.5%
Surprised 13%
Sad 11.1%
Disgusted 7.4%
Fear 2.4%
Happy 2.2%
Confused 2%

AWS Rekognition

Age 26-36
Gender Male, 62.6%
Calm 99.2%
Happy 0.2%
Sad 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 76.9%
Happy 12.5%
Sad 4.1%
Angry 2.9%
Confused 1%
Disgusted 0.9%
Surprised 0.9%
Fear 0.8%

AWS Rekognition

Age 20-28
Gender Male, 96.1%
Calm 78.6%
Angry 15.7%
Sad 2.5%
Happy 1.8%
Fear 0.7%
Confused 0.3%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.3%
Calm 56.7%
Sad 21.4%
Happy 8.5%
Fear 3.7%
Angry 3%
Confused 2.8%
Disgusted 2.3%
Surprised 1.5%

AWS Rekognition

Age 42-50
Gender Male, 94%
Calm 66.4%
Sad 26%
Happy 6.7%
Fear 0.3%
Angry 0.3%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 33-41
Gender Male, 98.4%
Calm 87.9%
Fear 7%
Sad 3.4%
Angry 0.9%
Disgusted 0.3%
Happy 0.3%
Confused 0.2%
Surprised 0.1%

AWS Rekognition

Age 31-41
Gender Female, 90.5%
Sad 58.8%
Angry 26.7%
Calm 4.6%
Confused 4.2%
Disgusted 2.3%
Fear 2.3%
Happy 0.6%
Surprised 0.5%

AWS Rekognition

Age 10-18
Gender Male, 98.2%
Calm 88.3%
Happy 4.8%
Sad 3.1%
Angry 1.3%
Confused 1.3%
Disgusted 0.6%
Surprised 0.4%
Fear 0.1%

AWS Rekognition

Age 14-22
Gender Male, 84.6%
Calm 46%
Sad 34.7%
Happy 7.8%
Angry 4.4%
Fear 3.4%
Disgusted 2.1%
Surprised 1%
Confused 0.5%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 86.4%
Sad 5%
Happy 4%
Angry 1.8%
Fear 1%
Surprised 0.8%
Confused 0.5%
Disgusted 0.5%

AWS Rekognition

Age 20-28
Gender Male, 85.6%
Calm 60.9%
Angry 12.2%
Fear 7.7%
Confused 5.8%
Surprised 5%
Sad 4.1%
Disgusted 3.1%
Happy 1.2%

AWS Rekognition

Age 20-28
Gender Male, 88.1%
Calm 93.1%
Fear 2.7%
Sad 1.4%
Surprised 1%
Angry 0.7%
Happy 0.6%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 24-34
Gender Female, 89%
Sad 98.6%
Angry 0.5%
Happy 0.4%
Calm 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0%

AWS Rekognition

Age 9-17
Gender Male, 98%
Calm 64%
Happy 16.4%
Surprised 9.8%
Confused 2.4%
Sad 2.4%
Fear 2.4%
Disgusted 1.3%
Angry 1.3%

AWS Rekognition

Age 23-33
Gender Female, 57.7%
Calm 99.2%
Sad 0.4%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0%
Happy 0%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Calm 77.1%
Surprised 11.2%
Fear 2.8%
Angry 2.6%
Disgusted 2.4%
Happy 1.6%
Sad 1.4%
Confused 1%

AWS Rekognition

Age 24-34
Gender Male, 98.9%
Calm 38.5%
Sad 16.6%
Happy 14.2%
Fear 10%
Confused 7.4%
Angry 6.3%
Disgusted 4.2%
Surprised 2.6%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 85.3%
Angry 12.4%
Sad 1.5%
Fear 0.2%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Female, 82.8%
Calm 72.2%
Fear 18.2%
Angry 4.8%
Sad 1.8%
Surprised 1.4%
Confused 0.6%
Happy 0.5%
Disgusted 0.4%

AWS Rekognition

Age 21-29
Gender Female, 98.4%
Calm 75.6%
Sad 21.4%
Angry 1.3%
Fear 0.6%
Surprised 0.4%
Disgusted 0.3%
Confused 0.3%
Happy 0.2%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 99.2%
Surprised 0.2%
Angry 0.2%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 16-22
Gender Female, 77%
Calm 50.7%
Angry 41.3%
Sad 3.1%
Fear 1.8%
Confused 1%
Happy 0.9%
Disgusted 0.6%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 88.4%

Categories

Imagga

paintings art 86.5%
food drinks 8.8%
interior objects 3.8%

Text analysis

Amazon

8
БОЙТ
ОТ БОЙТ
B
ОТ

Google

৪
৪