Human Generated Data

Title

Untitled (large group portrait of workers posing in front of construction site)

Date

1968

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9882

Human Generated Data

Title

Untitled (large group portrait of workers posing in front of construction site)

People

Artist: Martin Schweig, American 20th century

Date

1968

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 98.8
Person 98.8
Person 98.3
Person 97.4
Person 96.5
Person 96
Person 94.8
Person 92.7
Person 92.4
Crowd 88.8
Person 83.5
People 79.5
Person 75.1
Person 72.4
Text 71.5
Apparel 70.6
Clothing 70.6
Shorts 70.6
Drawing 69.3
Art 69.3
Parade 67.2
Person 66.7
Coat 66
Suit 66
Overcoat 66
Pedestrian 65.9
Audience 64
Person 62.7
Building 62.4
Face 58.9
Person 49.4

Imagga
created on 2022-01-28

blackboard 96.6
freight car 93
car 70.3
wheeled vehicle 55.8
vehicle 35.2
city 29.9
grunge 27.3
architecture 26.6
building 22.2
texture 20.8
old 20.2
urban 20.1
cityscape 19.9
structure 19.7
downtown 19.2
pattern 19.2
skyline 19
retro 18.9
night 18.7
conveyance 18.5
tower 17.9
vintage 17.4
landmark 16.3
antique 15.6
aged 15.4
business 15.2
light 14.7
dirty 14.5
design 14.1
skyscraper 13.4
grungy 13.3
town 13
wall 13
sky 12.8
travel 12.7
buildings 12.3
ancient 12.1
famous 12.1
text 11.4
bridge 11.4
billboard 11.2
art 11.1
frame 10.8
water 10.7
damaged 10.5
rough 10
border 10
signboard 9.9
modern 9.8
metropolis 9.8
reflection 9.7
black 9.6
scene 9.5
construction 9.4
paper 9.4
sea 9.4
space 9.3
wallpaper 9.2
ocean 9.1
tourism 9.1
paint 9.1
landscape 8.9
river 8.9
office 8.8
district 8.7
panorama 8.6
decoration 8.5
tall 8.5
evening 8.4
dark 8.4
color 8.3
tourist 8.2
history 8.1
financial 8
skyscrapers 7.8
chalk 7.8
pacific 7.7
blank 7.7
harbor 7.7
rusty 7.6
finance 7.6
weathered 7.6
backgrounds 7.3
digital 7.3

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 99.9
window 89.8
posing 80.6
blackboard 76.8
old 73.7
black 70.6
white 61.8
person 55.8

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 98.8%
Happy 83%
Calm 8.4%
Surprised 2.9%
Sad 2.1%
Disgusted 1.3%
Fear 1.1%
Angry 0.8%
Confused 0.4%

AWS Rekognition

Age 43-51
Gender Male, 84.4%
Happy 80.2%
Calm 10.5%
Sad 5.2%
Surprised 1.8%
Angry 1.2%
Fear 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 89%
Happy 45.7%
Calm 24.7%
Fear 21.8%
Surprised 5%
Sad 1%
Angry 0.8%
Confused 0.5%
Disgusted 0.5%

AWS Rekognition

Age 26-36
Gender Male, 84.2%
Calm 65.7%
Happy 33.1%
Surprised 0.4%
Sad 0.3%
Fear 0.3%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 42-50
Gender Male, 92.7%
Happy 79.3%
Fear 13.8%
Calm 2.8%
Surprised 2.4%
Sad 0.8%
Angry 0.4%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 37-45
Gender Female, 57.7%
Happy 73.4%
Calm 16.8%
Surprised 6%
Fear 1.8%
Confused 0.6%
Sad 0.5%
Angry 0.4%
Disgusted 0.4%

AWS Rekognition

Age 39-47
Gender Female, 71.5%
Happy 79.7%
Calm 13.4%
Sad 2.4%
Angry 1.8%
Confused 0.9%
Surprised 0.7%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 47-53
Gender Male, 94.3%
Calm 75.5%
Happy 16.6%
Sad 4.2%
Confused 1.6%
Surprised 1%
Angry 0.6%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Female, 95%
Happy 73.7%
Calm 24.3%
Surprised 0.5%
Fear 0.5%
Sad 0.3%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 48-54
Gender Female, 93.5%
Calm 86.5%
Happy 8.5%
Surprised 1.4%
Angry 1%
Sad 0.9%
Fear 0.6%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 47-53
Gender Male, 99%
Calm 49.5%
Happy 30.7%
Surprised 8.3%
Sad 5.3%
Fear 4.5%
Angry 0.7%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 39-47
Gender Female, 80.3%
Disgusted 72.8%
Calm 10.7%
Happy 8.6%
Surprised 3.2%
Fear 1.7%
Sad 1.3%
Angry 1%
Confused 0.7%

AWS Rekognition

Age 26-36
Gender Male, 97.6%
Calm 99.6%
Happy 0.1%
Sad 0.1%
Angry 0.1%
Fear 0%
Surprised 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 97.2%
Calm 94.9%
Happy 1.4%
Angry 1.1%
Surprised 0.9%
Fear 0.5%
Sad 0.5%
Disgusted 0.4%
Confused 0.4%

AWS Rekognition

Age 31-41
Gender Male, 97.9%
Happy 90.9%
Fear 4.4%
Calm 3.7%
Surprised 0.6%
Sad 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Female, 59%
Happy 54.9%
Disgusted 16.6%
Calm 11.4%
Confused 9.3%
Sad 4.2%
Surprised 2.3%
Fear 0.8%
Angry 0.5%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Fear 41.7%
Happy 40.7%
Sad 5.4%
Confused 4.7%
Calm 4.1%
Disgusted 1.5%
Angry 1.1%
Surprised 0.8%

AWS Rekognition

Age 38-46
Gender Male, 54.8%
Calm 64.8%
Fear 16.7%
Happy 6.4%
Sad 4.6%
Surprised 2.8%
Confused 2.2%
Angry 1.7%
Disgusted 0.8%

AWS Rekognition

Age 45-53
Gender Male, 83.4%
Calm 93%
Happy 6.5%
Sad 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 21-29
Gender Female, 57.1%
Happy 91.4%
Surprised 4.1%
Calm 2.1%
Angry 0.8%
Sad 0.8%
Fear 0.4%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Calm 71.3%
Confused 13%
Happy 6.8%
Sad 3.6%
Angry 3.1%
Surprised 1%
Disgusted 0.8%
Fear 0.4%

AWS Rekognition

Age 35-43
Gender Female, 68.1%
Calm 98.6%
Happy 1%
Sad 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0%

AWS Rekognition

Age 37-45
Gender Female, 64.8%
Happy 93.7%
Sad 2.5%
Calm 1.9%
Surprised 0.7%
Fear 0.4%
Disgusted 0.3%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 80.4%
Calm 96%
Angry 1.1%
Happy 0.9%
Fear 0.7%
Sad 0.6%
Surprised 0.3%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 40-48
Gender Male, 92.2%
Happy 69.1%
Calm 16%
Surprised 4.7%
Sad 3%
Angry 2.5%
Fear 2%
Disgusted 1.7%
Confused 1%

AWS Rekognition

Age 29-39
Gender Female, 91.6%
Calm 83.8%
Fear 8.2%
Happy 5%
Sad 1.7%
Surprised 0.4%
Angry 0.4%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 43-51
Gender Male, 95.2%
Calm 87.9%
Happy 11.1%
Surprised 0.3%
Sad 0.2%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 42-50
Gender Female, 50.7%
Happy 99.5%
Surprised 0.4%
Sad 0.1%
Fear 0.1%
Angry 0%
Calm 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 51-59
Gender Female, 97%
Happy 88.8%
Surprised 5.2%
Fear 2.3%
Calm 2.1%
Disgusted 0.5%
Sad 0.5%
Angry 0.4%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 96.6%
Happy 91.4%
Fear 3.6%
Sad 1.9%
Angry 1%
Surprised 0.6%
Confused 0.5%
Disgusted 0.5%
Calm 0.4%

AWS Rekognition

Age 37-45
Gender Male, 72.5%
Happy 98.2%
Calm 1.5%
Surprised 0.1%
Sad 0%
Angry 0%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Male, 88.1%
Happy 90.8%
Calm 5.5%
Fear 2.4%
Surprised 0.5%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%
Sad 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 80.7%
a vintage photo of a group of people posing for a picture 80.6%
a group of people posing for a photo 80.3%

Text analysis

Google

Xス
X