Human Generated Data

Title

Untitled (large group portrait of workers posing in front of construction site)
Date

1968
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9882

Human Generated Data

Title

Untitled (large group portrait of workers posing in front of construction site)

People

Artist: Martin Schweig, American 20th century

Date

1968

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9882

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 98.8
Human 98.8
Person 98.3
Person 97.4
Person 96.5
Person 96
Person 94.8
Person 92.7
Person 92.4
Crowd 88.8
Person 83.5
People 79.5
Person 75.1
Person 72.4
Text 71.5
Shorts 70.6
Clothing 70.6
Apparel 70.6
Drawing 69.3
Art 69.3
Parade 67.2
Person 66.7
Suit 66
Coat 66
Overcoat 66
Pedestrian 65.9
Audience 64
Person 62.7
Building 62.4
Face 58.9
Person 49.4

Clarifai
created on 2023-10-27

people 99.9
group 99.3
many 99.1
adult 98.6
print 96.5
man 95
woman 94.6
education 94.4
school 92.5
illustration 89.3
child 89
wear 88.6
uniform 88.2
snapshot 85.8
group together 84.7
art 84.6
boy 83.8
military 82.5
leader 82.1
war 81.6

Imagga
created on 2022-01-28

blackboard 96.6
freight car 93
car 70.3
wheeled vehicle 55.8
vehicle 35.2
city 29.9
grunge 27.3
architecture 26.6
building 22.2
texture 20.8
old 20.2
urban 20.1
cityscape 19.9
structure 19.7
downtown 19.2
pattern 19.2
skyline 19
retro 18.9
night 18.7
conveyance 18.5
tower 17.9
vintage 17.4
landmark 16.3
antique 15.6
aged 15.4
business 15.2
light 14.7
dirty 14.5
design 14.1
skyscraper 13.4
grungy 13.3
town 13
wall 13
sky 12.8
travel 12.7
buildings 12.3
ancient 12.1
famous 12.1
text 11.4
bridge 11.4
billboard 11.2
art 11.1
frame 10.8
water 10.7
damaged 10.5
rough 10
border 10
signboard 9.9
modern 9.8
metropolis 9.8
reflection 9.7
black 9.6
scene 9.5
construction 9.4
paper 9.4
sea 9.4
space 9.3
wallpaper 9.2
ocean 9.1
tourism 9.1
paint 9.1
landscape 8.9
river 8.9
office 8.8
district 8.7
panorama 8.6
decoration 8.5
tall 8.5
evening 8.4
dark 8.4
color 8.3
tourist 8.2
history 8.1
financial 8
skyscrapers 7.8
chalk 7.8
pacific 7.7
blank 7.7
harbor 7.7
rusty 7.6
finance 7.6
weathered 7.6
backgrounds 7.3
digital 7.3

Google
created on 2022-01-28

Art 80.9
Painting 80.7
Picture frame 79.8
Font 77.6
Rectangle 71.2
Visual arts 69.8
Event 66.7
Monochrome 63.5
History 63.4
Stock photography 61.7
Room 60.7
Monochrome photography 57
Drawing 56.7
Illustration 56.2
Artwork 54.6
Collection 54.4
Modern art 54.4
Building 53.4

Microsoft
created on 2022-01-28

text 99.9
window 89.8
posing 80.6
blackboard 76.8
old 73.7
black 70.6
white 61.8
person 55.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 98.8%
Happy 83%
Calm 8.4%
Surprised 2.9%
Sad 2.1%
Disgusted 1.3%
Fear 1.1%
Angry 0.8%
Confused 0.4%

AWS Rekognition

Age 43-51
Gender Male, 84.4%
Happy 80.2%
Calm 10.5%
Sad 5.2%
Surprised 1.8%
Angry 1.2%
Fear 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 89%
Happy 45.7%
Calm 24.7%
Fear 21.8%
Surprised 5%
Sad 1%
Angry 0.8%
Confused 0.5%
Disgusted 0.5%

AWS Rekognition

Age 26-36
Gender Male, 84.2%
Calm 65.7%
Happy 33.1%
Surprised 0.4%
Sad 0.3%
Fear 0.3%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 42-50
Gender Male, 92.7%
Happy 79.3%
Fear 13.8%
Calm 2.8%
Surprised 2.4%
Sad 0.8%
Angry 0.4%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 37-45
Gender Female, 57.7%
Happy 73.4%
Calm 16.8%
Surprised 6%
Fear 1.8%
Confused 0.6%
Sad 0.5%
Angry 0.4%
Disgusted 0.4%

AWS Rekognition

Age 39-47
Gender Female, 71.5%
Happy 79.7%
Calm 13.4%
Sad 2.4%
Angry 1.8%
Confused 0.9%
Surprised 0.7%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 47-53
Gender Male, 94.3%
Calm 75.5%
Happy 16.6%
Sad 4.2%
Confused 1.6%
Surprised 1%
Angry 0.6%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Female, 95%
Happy 73.7%
Calm 24.3%
Surprised 0.5%
Fear 0.5%
Sad 0.3%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 48-54
Gender Female, 93.5%
Calm 86.5%
Happy 8.5%
Surprised 1.4%
Angry 1%
Sad 0.9%
Fear 0.6%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 47-53
Gender Male, 99%
Calm 49.5%
Happy 30.7%
Surprised 8.3%
Sad 5.3%
Fear 4.5%
Angry 0.7%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 39-47
Gender Female, 80.3%
Disgusted 72.8%
Calm 10.7%
Happy 8.6%
Surprised 3.2%
Fear 1.7%
Sad 1.3%
Angry 1%
Confused 0.7%

AWS Rekognition

Age 26-36
Gender Male, 97.6%
Calm 99.6%
Happy 0.1%
Sad 0.1%
Angry 0.1%
Fear 0%
Surprised 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 97.2%
Calm 94.9%
Happy 1.4%
Angry 1.1%
Surprised 0.9%
Fear 0.5%
Sad 0.5%
Disgusted 0.4%
Confused 0.4%

AWS Rekognition

Age 31-41
Gender Male, 97.9%
Happy 90.9%
Fear 4.4%
Calm 3.7%
Surprised 0.6%
Sad 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Female, 59%
Happy 54.9%
Disgusted 16.6%
Calm 11.4%
Confused 9.3%
Sad 4.2%
Surprised 2.3%
Fear 0.8%
Angry 0.5%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Fear 41.7%
Happy 40.7%
Sad 5.4%
Confused 4.7%
Calm 4.1%
Disgusted 1.5%
Angry 1.1%
Surprised 0.8%

AWS Rekognition

Age 38-46
Gender Male, 54.8%
Calm 64.8%
Fear 16.7%
Happy 6.4%
Sad 4.6%
Surprised 2.8%
Confused 2.2%
Angry 1.7%
Disgusted 0.8%

AWS Rekognition

Age 45-53
Gender Male, 83.4%
Calm 93%
Happy 6.5%
Sad 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 21-29
Gender Female, 57.1%
Happy 91.4%
Surprised 4.1%
Calm 2.1%
Angry 0.8%
Sad 0.8%
Fear 0.4%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Calm 71.3%
Confused 13%
Happy 6.8%
Sad 3.6%
Angry 3.1%
Surprised 1%
Disgusted 0.8%
Fear 0.4%

AWS Rekognition

Age 35-43
Gender Female, 68.1%
Calm 98.6%
Happy 1%
Sad 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0%

AWS Rekognition

Age 37-45
Gender Female, 64.8%
Happy 93.7%
Sad 2.5%
Calm 1.9%
Surprised 0.7%
Fear 0.4%
Disgusted 0.3%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 80.4%
Calm 96%
Angry 1.1%
Happy 0.9%
Fear 0.7%
Sad 0.6%
Surprised 0.3%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 40-48
Gender Male, 92.2%
Happy 69.1%
Calm 16%
Surprised 4.7%
Sad 3%
Angry 2.5%
Fear 2%
Disgusted 1.7%
Confused 1%

AWS Rekognition

Age 29-39
Gender Female, 91.6%
Calm 83.8%
Fear 8.2%
Happy 5%
Sad 1.7%
Surprised 0.4%
Angry 0.4%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 43-51
Gender Male, 95.2%
Calm 87.9%
Happy 11.1%
Surprised 0.3%
Sad 0.2%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 42-50
Gender Female, 50.7%
Happy 99.5%
Surprised 0.4%
Sad 0.1%
Fear 0.1%
Angry 0%
Calm 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 51-59
Gender Female, 97%
Happy 88.8%
Surprised 5.2%
Fear 2.3%
Calm 2.1%
Disgusted 0.5%
Sad 0.5%
Angry 0.4%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 96.6%
Happy 91.4%
Fear 3.6%
Sad 1.9%
Angry 1%
Surprised 0.6%
Confused 0.5%
Disgusted 0.5%
Calm 0.4%

AWS Rekognition

Age 37-45
Gender Male, 72.5%
Happy 98.2%
Calm 1.5%
Surprised 0.1%
Sad 0%
Angry 0%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Male, 88.1%
Happy 90.8%
Calm 5.5%
Fear 2.4%
Surprised 0.5%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%
Sad 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.8%
Person 98.3%
Person 97.4%
Person 96.5%
Person 96%
Person 94.8%
Person 92.7%
Person 92.4%
Person 83.5%
Person 75.1%
Person 72.4%
Person 66.7%
Person 62.7%
Person 49.4%

Text analysis

Google

Xス
X
ス