Human Generated Data

Title

Untitled (Bands ar Orange Bowl game)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4524
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Bands ar Orange Bowl game)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4524

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 98.4
Human 98.4
Person 97.8
Crowd 97.6
Person 97.4
Audience 97.4
Person 87.3
Marching 86.8
People 86.6
Person 77.3
Parade 60.8
Festival 57.7
Person 52.6
Person 45.1
Person 45

Clarifai
created on 2023-10-29

people 99.7
group together 97.9
crowd 97.8
many 97.5
group 97.1
man 97
ceremony 95.4
military 95.3
street 94.6
flag 94.6
celebration 94.4
uniform 92.9
city 90.5
woman 89.9
festival 89.3
parade 87
band 85.8
squad 85.7
child 85.6
audience 84.8

Imagga
created on 2022-02-05

city 39.1
military uniform 30.9
uniform 27.6
travel 27.5
architecture 26.5
town 26
private 24.9
cityscape 24.6
sky 21.2
stage 19.6
building 19.5
tourism 19
clothing 18.6
spectator 18.5
church 17.6
landscape 16.4
old 16
urban 15.7
landmark 15.3
panorama 15.2
buildings 15.1
platform 15.1
aerial 13.6
consumer goods 12.4
covering 12.4
sea 11.7
houses 11.6
summer 11.6
pedestrian 11.2
scenery 10.8
history 10.7
skyline 10.4
person 10.1
fan 10
river 9.8
rural 9.7
sun 9.7
structure 9.7
roof 9.6
village 9.6
panoramic 9.6
center 9.5
clouds 9.3
street 9.2
military 8.7
high 8.7
scene 8.7
patriot 8.6
statue 8.6
culture 8.5
famous 8.4
field 8.4
outdoors 8.2
follower 8.1
religion 8.1
tower 8.1
trees 8
water 8
scenic 7.9
roofs 7.9
day 7.8
rock 7.8
people 7.8
tourist 7.8
cathedral 7.7
sculpture 7.6
house 7.5
hill 7.5
traditional 7.5
vacation 7.4
historic 7.3
color 7.2
horizon 7.2

Google
created on 2022-02-05

Photograph 94.2
Sky 90.4
Crowd 82.7
Fan 81.3
Watercraft 78.6
Travel 76.3
Plant 75.8
Leisure 74.3
Event 73.7
Fun 67.9
Crew 67.8
Public event 66.2
Stock photography 63.3
Team 62.7
Pole 62.2
Audience 61.3
Tourism 60.5
Festival 59.9
Metal 59.8
City 56.6

Microsoft
created on 2022-02-05

person 97.2
text 96.6
funeral 66.1
clothing 60.8
festival 56.3
posing 38.2
crowd 36.4
auditorium 31.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 98.4%
Happy 65.6%
Calm 15%
Fear 5.8%
Surprised 3.7%
Confused 3.3%
Angry 2.4%
Sad 2.1%
Disgusted 2.1%

AWS Rekognition

Age 13-21
Gender Female, 99.7%
Disgusted 36.3%
Sad 14.1%
Fear 13.6%
Angry 11.9%
Calm 11.2%
Confused 6.5%
Happy 3.3%
Surprised 3.1%

AWS Rekognition

Age 2-8
Gender Female, 100%
Happy 71%
Calm 15.3%
Sad 5.5%
Angry 3.9%
Confused 2.4%
Disgusted 0.9%
Fear 0.6%
Surprised 0.5%

AWS Rekognition

Age 30-40
Gender Female, 99.9%
Calm 99.2%
Angry 0.2%
Sad 0.2%
Surprised 0.1%
Fear 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 6-12
Gender Female, 100%
Calm 66.6%
Sad 20.9%
Disgusted 6.5%
Confused 1.8%
Happy 1.7%
Angry 1.7%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 33-41
Gender Female, 99.8%
Happy 76.2%
Calm 20.6%
Surprised 0.9%
Confused 0.8%
Disgusted 0.7%
Angry 0.4%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Female, 95.1%
Sad 37.5%
Calm 24.6%
Happy 11.4%
Angry 7.4%
Fear 5.8%
Disgusted 5.6%
Surprised 5.2%
Confused 2.4%

AWS Rekognition

Age 22-30
Gender Female, 98.3%
Sad 75.9%
Calm 9.3%
Confused 6.4%
Angry 4.9%
Disgusted 2%
Fear 0.7%
Surprised 0.6%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Female, 99.5%
Calm 51.2%
Angry 33.6%
Fear 4.2%
Surprised 4.1%
Happy 3.9%
Sad 1.3%
Confused 0.9%
Disgusted 0.9%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Sad 54.4%
Calm 23.3%
Fear 13.6%
Angry 3.5%
Confused 2%
Disgusted 1.2%
Happy 1.1%
Surprised 0.9%

AWS Rekognition

Age 10-18
Gender Male, 75.1%
Calm 71.3%
Sad 23.7%
Angry 1.7%
Fear 1.2%
Disgusted 1.2%
Confused 0.4%
Happy 0.3%
Surprised 0.2%

AWS Rekognition

Age 26-36
Gender Male, 81.5%
Calm 74.6%
Sad 12.4%
Angry 6.4%
Happy 2.2%
Disgusted 1.5%
Fear 1.5%
Surprised 0.8%
Confused 0.7%

AWS Rekognition

Age 28-38
Gender Female, 100%
Sad 97.1%
Calm 0.6%
Happy 0.6%
Angry 0.5%
Disgusted 0.4%
Surprised 0.4%
Fear 0.3%
Confused 0.1%

AWS Rekognition

Age 4-10
Gender Male, 96.8%
Calm 55%
Fear 19.1%
Disgusted 8.4%
Confused 5.2%
Angry 4.5%
Sad 3.2%
Surprised 2.5%
Happy 2.2%

AWS Rekognition

Age 2-8
Gender Female, 71.4%
Calm 57.7%
Sad 33.5%
Angry 3.2%
Disgusted 2.7%
Fear 1.1%
Happy 0.6%
Surprised 0.6%
Confused 0.5%

AWS Rekognition

Age 33-41
Gender Male, 98.5%
Calm 92.2%
Fear 4.9%
Sad 1.3%
Angry 0.6%
Surprised 0.4%
Disgusted 0.2%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 9-17
Gender Female, 83.2%
Sad 60.7%
Calm 27.9%
Fear 3.7%
Angry 2.6%
Surprised 1.7%
Disgusted 1.5%
Happy 1.4%
Confused 0.6%

AWS Rekognition

Age 11-19
Gender Male, 93.9%
Fear 30.3%
Happy 23%
Surprised 17.5%
Sad 10.4%
Calm 5.6%
Confused 5.3%
Angry 5%
Disgusted 3%

AWS Rekognition

Age 33-41
Gender Male, 68.7%
Sad 93.8%
Fear 4%
Calm 0.6%
Angry 0.5%
Confused 0.4%
Disgusted 0.3%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 23-31
Gender Male, 95.3%
Sad 49%
Fear 25.8%
Calm 9.3%
Angry 6.4%
Surprised 3.2%
Confused 2.9%
Disgusted 2.3%
Happy 0.9%

AWS Rekognition

Age 23-33
Gender Male, 98.7%
Angry 55.9%
Disgusted 18.1%
Fear 7.1%
Surprised 6.6%
Sad 5.6%
Calm 4.7%
Confused 1.6%
Happy 0.4%

AWS Rekognition

Age 4-12
Gender Female, 90%
Calm 76.2%
Angry 6.5%
Fear 4.9%
Happy 4.8%
Sad 4.7%
Disgusted 1.4%
Confused 0.9%
Surprised 0.7%

AWS Rekognition

Age 7-17
Gender Female, 98%
Confused 45.5%
Calm 29.1%
Angry 9.1%
Sad 5%
Happy 3.9%
Surprised 2.9%
Disgusted 2.4%
Fear 2.1%

AWS Rekognition

Age 30-40
Gender Female, 88.8%
Fear 43.3%
Disgusted 38.6%
Sad 7.2%
Angry 4.7%
Confused 2.6%
Calm 2.6%
Surprised 0.6%
Happy 0.3%

AWS Rekognition

Age 2-8
Gender Male, 99.7%
Confused 44%
Calm 20.9%
Sad 19.5%
Disgusted 8%
Angry 2.3%
Fear 2.1%
Happy 1.8%
Surprised 1.4%

AWS Rekognition

Age 35-43
Gender Male, 78.4%
Calm 97.1%
Sad 1.3%
Confused 0.4%
Angry 0.3%
Surprised 0.3%
Disgusted 0.3%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 9-17
Gender Male, 57.2%
Calm 94%
Sad 3.3%
Fear 0.8%
Happy 0.6%
Disgusted 0.5%
Angry 0.4%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 25-35
Gender Male, 98.8%
Calm 82.9%
Sad 12.1%
Fear 2.1%
Confused 1.1%
Disgusted 0.5%
Angry 0.5%
Surprised 0.4%
Happy 0.2%

AWS Rekognition

Age 7-17
Gender Female, 99.8%
Fear 66.6%
Calm 15.7%
Sad 9%
Confused 2.6%
Angry 1.9%
Disgusted 1.4%
Surprised 1.4%
Happy 1.3%

AWS Rekognition

Age 18-26
Gender Male, 81.2%
Calm 64.6%
Sad 13%
Fear 12.4%
Happy 4.2%
Confused 2%
Angry 1.8%
Disgusted 1.3%
Surprised 0.7%

AWS Rekognition

Age 19-27
Gender Male, 65.6%
Fear 55.9%
Happy 15.6%
Sad 12.4%
Angry 3.7%
Surprised 3.5%
Calm 3.3%
Disgusted 3%
Confused 2.6%

AWS Rekognition

Age 18-24
Gender Female, 99%
Calm 68.5%
Happy 10.3%
Fear 6.8%
Angry 3.8%
Sad 3.6%
Surprised 3%
Disgusted 2.3%
Confused 1.7%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Calm 38.5%
Angry 26.6%
Sad 15.9%
Surprised 9.9%
Confused 3.6%
Disgusted 3.2%
Happy 1.4%
Fear 0.8%

AWS Rekognition

Age 18-24
Gender Male, 95.4%
Fear 81.7%
Calm 10.3%
Angry 3.8%
Sad 1.3%
Happy 1.2%
Surprised 0.7%
Disgusted 0.6%
Confused 0.4%

AWS Rekognition

Age 13-21
Gender Male, 94.3%
Calm 79.3%
Confused 9.8%
Angry 5.2%
Sad 3.5%
Surprised 0.9%
Disgusted 0.6%
Fear 0.4%
Happy 0.3%

AWS Rekognition

Age 14-22
Gender Male, 98.6%
Calm 94.6%
Angry 2.3%
Sad 1.4%
Surprised 0.4%
Disgusted 0.4%
Confused 0.4%
Fear 0.3%
Happy 0.3%

AWS Rekognition

Age 19-27
Gender Male, 80.7%
Fear 81.9%
Happy 6%
Sad 5.2%
Calm 2.7%
Angry 1.6%
Surprised 1.1%
Disgusted 1%
Confused 0.5%

AWS Rekognition

Age 21-29
Gender Female, 100%
Sad 99.8%
Calm 0.1%
Fear 0.1%
Angry 0%
Disgusted 0%
Happy 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 39-47
Gender Female, 54%
Happy 67.5%
Sad 12.9%
Angry 8.2%
Disgusted 5.6%
Fear 2%
Calm 1.7%
Surprised 1.2%
Confused 0.7%

AWS Rekognition

Age 4-10
Gender Male, 53.1%
Fear 34.1%
Calm 26.6%
Sad 15.5%
Happy 10%
Confused 4.7%
Surprised 3.6%
Angry 3.6%
Disgusted 2%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Surprised 31.1%
Calm 29.2%
Angry 24.8%
Happy 9.3%
Sad 2.2%
Fear 1.8%
Disgusted 1.2%
Confused 0.5%

AWS Rekognition

Age 13-21
Gender Male, 99.4%
Calm 31.3%
Angry 29%
Disgusted 15.5%
Sad 5.9%
Happy 5.6%
Fear 5%
Confused 4.5%
Surprised 3.3%

AWS Rekognition

Age 18-24
Gender Female, 73.1%
Calm 93.8%
Sad 3%
Fear 1.8%
Angry 0.4%
Surprised 0.4%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 18-26
Gender Male, 98.4%
Calm 89.9%
Sad 5.5%
Confused 2.2%
Fear 1.2%
Angry 0.4%
Disgusted 0.4%
Happy 0.3%
Surprised 0.2%

AWS Rekognition

Age 28-38
Gender Male, 97.1%
Calm 73.1%
Fear 10.4%
Happy 5.1%
Surprised 3.9%
Sad 3.9%
Disgusted 1.7%
Angry 1.3%
Confused 0.6%

AWS Rekognition

Age 16-24
Gender Female, 98.8%
Fear 83.6%
Calm 10%
Happy 3.8%
Angry 1%
Surprised 0.8%
Sad 0.4%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 20-28
Gender Female, 61.8%
Sad 62.5%
Calm 10.9%
Fear 8%
Angry 7.3%
Surprised 6.6%
Disgusted 2.8%
Confused 1.2%
Happy 0.7%

AWS Rekognition

Age 6-12
Gender Male, 99.9%
Calm 95.1%
Sad 2.2%
Happy 0.6%
Surprised 0.6%
Angry 0.6%
Disgusted 0.4%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 6-12
Gender Male, 97.7%
Sad 44.8%
Calm 22.6%
Happy 10.1%
Confused 7.6%
Fear 6.9%
Surprised 3.8%
Angry 2.2%
Disgusted 2.1%

AWS Rekognition

Age 19-27
Gender Male, 98.8%
Calm 41.2%
Confused 22.7%
Sad 9.9%
Surprised 9.3%
Angry 6.2%
Disgusted 5.4%
Happy 3.2%
Fear 2.2%

AWS Rekognition

Age 21-29
Gender Male, 66.9%
Calm 27.6%
Disgusted 25.3%
Fear 14.2%
Sad 12.5%
Angry 10.2%
Surprised 4.1%
Happy 3.2%
Confused 3%

AWS Rekognition

Age 12-20
Gender Female, 66.2%
Calm 94%
Confused 2%
Surprised 1.4%
Sad 0.9%
Fear 0.7%
Disgusted 0.5%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 16-24
Gender Male, 98.5%
Calm 95.5%
Fear 1.1%
Confused 1.1%
Sad 1%
Angry 0.6%
Disgusted 0.4%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 13-21
Gender Male, 89.2%
Confused 37%
Sad 25.6%
Fear 13.4%
Calm 11.1%
Surprised 6.2%
Disgusted 2.5%
Angry 2.3%
Happy 1.8%

AWS Rekognition

Age 12-20
Gender Female, 52%
Fear 84.1%
Sad 9.5%
Calm 2.3%
Angry 1.6%
Surprised 1.4%
Happy 0.5%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 16-24
Gender Male, 75.2%
Fear 47.5%
Calm 17.9%
Sad 13.6%
Angry 11.7%
Happy 3.1%
Disgusted 2.6%
Confused 2.2%
Surprised 1.4%

AWS Rekognition

Age 39-47
Gender Male, 77.6%
Calm 46.5%
Sad 26.3%
Fear 21.6%
Surprised 1.5%
Disgusted 1.4%
Angry 1.2%
Happy 1%
Confused 0.5%

AWS Rekognition

Age 16-24
Gender Male, 99.5%
Angry 90.7%
Calm 6%
Confused 1%
Sad 1%
Happy 0.4%
Surprised 0.3%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Female, 97.6%
Angry 66.8%
Calm 14.5%
Fear 8.5%
Sad 6.6%
Disgusted 1.9%
Happy 0.7%
Surprised 0.6%
Confused 0.5%

AWS Rekognition

Age 4-12
Gender Male, 91.1%
Calm 75.6%
Fear 14.9%
Angry 4.4%
Sad 2.1%
Disgusted 1%
Happy 0.8%
Surprised 0.8%
Confused 0.4%

AWS Rekognition

Age 39-47
Gender Female, 66.1%
Happy 75.1%
Disgusted 14.6%
Confused 3.5%
Calm 2.2%
Sad 1.9%
Surprised 1.3%
Angry 0.8%
Fear 0.5%

AWS Rekognition

Age 20-28
Gender Male, 95.9%
Calm 29.8%
Happy 19.1%
Sad 15.6%
Fear 10.8%
Disgusted 7.3%
Surprised 7.1%
Confused 6.6%
Angry 3.7%

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.4%
Person 97.8%
Person 97.4%
Person 87.3%
Person 77.3%
Person 52.6%
Person 45.1%
Person 45%

Text analysis

Amazon

JACKSON
SARASOTA,
STEINMETZ, SARASOTA, FLORIDA
FLORIDA
STEINMETZ,
BAND
MIAMI
WE
D
STAND
KSON
BAND Sex
WE AVEEX
KB STAND
DADOX
JACKSONATSUN
SISON
Sex
WILK
AVEEX
KB

Google

MIA JACKSO RAN MIAM JACKSON BAND MIAMI SON MIAN MIAMI PESOMJACKSON BAND STEINMETZ,-SARASOTA, FLORIDA
MIA
JACKSO
RAN
MIAM
JACKSON
BAND
MIAMI
SON
MIAN
PESOMJACKSON
STEINMETZ,-SARASOTA,
FLORIDA