Human Generated Data

Title

Untitled (Civil Works Administration demonstration, United States Customs' House, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4248

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, United States Customs' House, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 100
Apparel 100
Person 98.9
Human 98.9
Person 98.9
Person 97.7
Cowboy Hat 97.3
Person 96.7
Person 96.5
Person 94.8
Hat 92.9
Person 91.3
Sun Hat 80.9
Person 72.4
Person 56.4

Imagga
created on 2022-01-08

cowboy hat 100
hat 78.4
headdress 60.8
chair 59.6
seat 48.1
clothing 39.6
support 35.8
cup 33.6
coffee 26.9
device 24.3
covering 22.2
tea 20.8
consumer goods 20.3
drink 20
food 18
saucer 15.5
close 15.4
plate 15.2
brown 14.7
black 14.4
morning 13.6
breakfast 13.5
cups 12.7
restaurant 12.5
business 11.5
sugar 11.2
beverage 11.2
empty 11.2
chocolate 10.8
keyboard 10.7
mug 10.6
health 10.4
table 10.4
dark 10
espresso 9.8
caffeine 9.7
break 9.5
closeup 9.4
work 9.4
aroma 9.4
row 9.3
delicious 9.1
refreshment 8.8
spoon 8.6
luxury 8.6
meal 8.6
hot 8.4
dinner 8.3
porcelain 8.2
china 8.2
spa 8.1
silver 8
sweet 7.9
color 7.8
pastry 7.6
heap 7.5
light 7.3
decoration 7.2
computer 7.2
dessert 7.1
modern 7

Google
created on 2022-01-08

Serveware 84.3
Headgear 82.3
Font 76
Art 73.4
Monochrome photography 71.8
Pottery 70.8
Personal protective equipment 70.1
Event 68.8
Monochrome 66.3
Room 66.1
Artifact 65.3
History 64
Still life photography 63.5
Pattern 60.1
Collection 58.7
Visual arts 56
Tourist attraction 55.6
Vintage clothing 55.1
Still life 54.9
earthenware 53.8

Microsoft
created on 2022-01-08

indoor 92
hat 79.2
crowd 0.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 90.6%
Sad 2.8%
Surprised 1.4%
Disgusted 1.3%
Confused 1.3%
Angry 1%
Fear 1%
Happy 0.7%

AWS Rekognition

Age 25-35
Gender Male, 100%
Sad 81.9%
Calm 16.6%
Confused 0.5%
Fear 0.4%
Angry 0.2%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 95.7%
Sad 4.2%
Confused 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 31-41
Gender Male, 100%
Sad 46.7%
Calm 46%
Surprised 3.2%
Fear 1.8%
Angry 1%
Confused 0.8%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 76.7%
Sad 16.5%
Surprised 2.6%
Angry 1.9%
Confused 0.9%
Fear 0.6%
Happy 0.4%
Disgusted 0.4%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Calm 52.6%
Sad 23.8%
Happy 10.9%
Angry 5.5%
Surprised 3.5%
Confused 1.4%
Fear 1.3%
Disgusted 0.9%

AWS Rekognition

Age 38-46
Gender Male, 99.4%
Sad 57.9%
Calm 39.8%
Angry 1.2%
Happy 0.7%
Confused 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 39-47
Gender Female, 96.2%
Calm 70.3%
Happy 25.9%
Sad 1.7%
Disgusted 0.8%
Fear 0.6%
Surprised 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 38-46
Gender Male, 97.8%
Calm 92.2%
Sad 5.2%
Confused 0.7%
Surprised 0.7%
Angry 0.4%
Disgusted 0.4%
Fear 0.3%
Happy 0.1%

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 86.7%
Fear 3.4%
Sad 3%
Confused 1.9%
Surprised 1.6%
Happy 1.5%
Angry 1.4%
Disgusted 0.5%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 98%
Sad 1.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Calm 91%
Angry 4.4%
Sad 1.6%
Surprised 1.5%
Confused 0.6%
Fear 0.5%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 43-51
Gender Male, 100%
Confused 60.8%
Calm 31.5%
Sad 3%
Surprised 2.4%
Angry 0.9%
Disgusted 0.8%
Happy 0.3%
Fear 0.3%

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 99.7%
Surprised 0.1%
Sad 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 78.4%
Fear 10.3%
Surprised 4.4%
Sad 2.5%
Angry 1.8%
Happy 1.7%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 30-40
Gender Male, 99.7%
Calm 98.7%
Angry 0.4%
Disgusted 0.2%
Confused 0.2%
Surprised 0.2%
Happy 0.1%
Fear 0.1%
Sad 0%

AWS Rekognition

Age 25-35
Gender Male, 86.7%
Calm 76.9%
Surprised 12.2%
Fear 3.9%
Happy 2.8%
Angry 1.8%
Disgusted 0.9%
Sad 0.9%
Confused 0.6%

AWS Rekognition

Age 28-38
Gender Male, 99.2%
Calm 87.6%
Happy 5.6%
Surprised 2.2%
Angry 1.8%
Sad 1.1%
Fear 0.8%
Disgusted 0.6%
Confused 0.2%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Calm 96.5%
Sad 2.3%
Angry 0.4%
Disgusted 0.3%
Confused 0.2%
Happy 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 99.2%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Sad 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Female, 91.7%
Calm 80.6%
Fear 4.4%
Happy 3.3%
Sad 3.2%
Angry 2.6%
Surprised 2.6%
Confused 2%
Disgusted 1.2%

AWS Rekognition

Age 26-36
Gender Male, 99%
Calm 56.9%
Happy 28.6%
Angry 5.4%
Sad 4.7%
Surprised 1.9%
Disgusted 1%
Confused 1%
Fear 0.4%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 99.7%
Sad 0.2%
Angry 0%
Happy 0%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 38-46
Gender Male, 99.6%
Calm 96.2%
Sad 1.4%
Happy 1%
Angry 0.9%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 98.8%
Angry 0.4%
Sad 0.3%
Confused 0.3%
Disgusted 0.1%
Surprised 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 31-41
Gender Male, 99.3%
Calm 75.3%
Happy 11%
Angry 7.7%
Sad 3.9%
Surprised 0.9%
Fear 0.6%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99%
Calm 95.2%
Happy 2.6%
Sad 0.7%
Surprised 0.5%
Disgusted 0.4%
Angry 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Calm 94.9%
Sad 2.1%
Surprised 0.6%
Happy 0.6%
Disgusted 0.5%
Angry 0.4%
Fear 0.4%
Confused 0.4%

AWS Rekognition

Age 18-26
Gender Male, 99.7%
Calm 92.2%
Sad 3.2%
Angry 3.1%
Confused 0.8%
Happy 0.3%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 18-24
Gender Female, 54.7%
Calm 46.5%
Confused 19.9%
Sad 19%
Fear 7%
Surprised 4.2%
Angry 1.9%
Disgusted 1.1%
Happy 0.4%

AWS Rekognition

Age 16-22
Gender Male, 97.4%
Calm 89%
Disgusted 5.8%
Confused 1.4%
Sad 0.9%
Happy 0.8%
Surprised 0.8%
Fear 0.7%
Angry 0.6%

AWS Rekognition

Age 22-30
Gender Female, 73.2%
Calm 65.6%
Happy 12%
Fear 8%
Sad 3.6%
Disgusted 3.6%
Angry 3%
Confused 2.8%
Surprised 1.3%

AWS Rekognition

Age 23-33
Gender Male, 89.7%
Sad 60.4%
Calm 24.6%
Surprised 5.4%
Confused 3.4%
Angry 2.1%
Disgusted 1.6%
Happy 1.3%
Fear 1.2%

AWS Rekognition

Age 18-24
Gender Male, 98.7%
Calm 58.5%
Sad 21.5%
Disgusted 5.8%
Angry 5.6%
Fear 4.8%
Happy 1.6%
Surprised 1.4%
Confused 0.8%

AWS Rekognition

Age 21-29
Gender Male, 99.3%
Calm 89.2%
Surprised 2.2%
Sad 2%
Happy 1.9%
Disgusted 1.3%
Fear 1.2%
Confused 1.1%
Angry 1%

AWS Rekognition

Age 23-33
Gender Male, 98.9%
Calm 99.8%
Surprised 0.1%
Sad 0%
Angry 0%
Fear 0%
Disgusted 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 90.8%
Surprised 4.2%
Angry 2.5%
Happy 0.7%
Sad 0.6%
Confused 0.5%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 59-67
Gender Male, 99.9%
Calm 91%
Sad 4.6%
Surprised 1.6%
Fear 0.8%
Disgusted 0.8%
Angry 0.4%
Happy 0.4%
Confused 0.4%

AWS Rekognition

Age 36-44
Gender Male, 91.9%
Calm 98.5%
Happy 1%
Angry 0.2%
Sad 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 76.8%
Calm 96.1%
Sad 2.5%
Happy 0.8%
Surprised 0.2%
Angry 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 11-19
Gender Male, 95.1%
Calm 85.7%
Sad 9.2%
Confused 1.9%
Angry 1%
Surprised 0.9%
Fear 0.5%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Male, 91.2%
Fear 75.3%
Calm 22.9%
Disgusted 0.4%
Angry 0.4%
Sad 0.3%
Happy 0.3%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 33-41
Gender Female, 96.2%
Sad 61.5%
Surprised 12.6%
Happy 9.9%
Calm 6.6%
Angry 4.2%
Disgusted 2%
Fear 1.7%
Confused 1.5%

AWS Rekognition

Age 19-27
Gender Female, 99.7%
Calm 93.2%
Sad 3.1%
Surprised 1.7%
Angry 0.7%
Confused 0.5%
Disgusted 0.3%
Fear 0.3%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Female, 90.6%
Calm 71.1%
Angry 13.3%
Sad 4.9%
Happy 4.4%
Confused 1.9%
Fear 1.8%
Surprised 1.3%
Disgusted 1.3%

AWS Rekognition

Age 23-31
Gender Male, 93.8%
Sad 77.4%
Calm 11.6%
Disgusted 4.7%
Angry 2.7%
Confused 1.6%
Happy 0.8%
Fear 0.7%
Surprised 0.6%

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Happy 51.8%
Calm 42%
Surprised 2.1%
Angry 1.3%
Sad 1.3%
Confused 0.7%
Disgusted 0.6%
Fear 0.2%

AWS Rekognition

Age 40-48
Gender Male, 89.7%
Calm 77.3%
Angry 12.3%
Sad 3.6%
Confused 2%
Disgusted 1.9%
Happy 1.9%
Surprised 0.7%
Fear 0.3%

AWS Rekognition

Age 18-24
Gender Male, 98.8%
Happy 53.5%
Sad 24.6%
Calm 12.5%
Fear 4.1%
Angry 1.8%
Disgusted 1.7%
Surprised 1.3%
Confused 0.5%

AWS Rekognition

Age 24-34
Gender Male, 97.9%
Calm 91.9%
Happy 5.4%
Surprised 0.9%
Angry 0.7%
Sad 0.4%
Disgusted 0.3%
Confused 0.3%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 98.2%
Calm 86.7%
Fear 6.7%
Sad 3.2%
Surprised 1.3%
Happy 0.8%
Disgusted 0.5%
Angry 0.5%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Hat 92.9%

Captions

Microsoft

a group of men standing next to a window 29.3%
a group of people in a room 29.2%
a group of people posing for a photo 29.1%

Text analysis

Amazon

CUP
NURNEPS CUP
...
NURNEPS
МОМА
ОБНЫ
LUM