Human Generated Data

Title

Untitled (group of men in suits near a pool)

Date

c. 1960

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8133

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of men in suits near a pool)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99.3
Person 99.3
Person 99.2
Person 99
Accessory 98.8
Accessories 98.8
Tie 98.8
Person 98.8
Person 98.5
Person 97.8
Person 97.4
Person 96.5
Interior Design 94.6
Indoors 94.6
Clothing 86.8
Apparel 86.8
Person 85.6
Tie 82.2
Tie 79.6
Person 78.1
Crowd 77.2
Person 77.1
Person 76.8
Tie 67.4
Advertisement 64.4
Collage 64.4
Poster 64.4
Audience 64.2
Leisure Activities 62.1
Furniture 60.9
Chair 60.9
Room 58.8
Dance Pose 57.6
Shorts 56.5
Art 56
Person 53.7

Imagga
created on 2022-01-15

stage 23.3
art 17.8
platform 17.3
people 16.7
sculpture 15.7
crowd 15.3
city 14.1
old 13.9
speedway 13.3
shop 12.9
business 12.7
group 12.1
men 12
shoe shop 11.7
travel 11.3
culture 11.1
facility 11
history 10.7
racetrack 10.7
statue 10.6
urban 10.5
decoration 10.4
architecture 10.3
power 10.1
tourism 9.9
flag 9.8
building 9.7
black 9.6
scene 9.5
monument 9.3
station 9.3
famous 9.3
carousel 9.2
speed 9.1
transportation 9
metal 8.8
engine 8.7
machine 8.6
industry 8.5
male 8.5
world 8.2
boutique 8.2
industrial 8.2
mercantile establishment 8.1
train 8.1
religion 8.1
brass 8
antique 8
steel 7.9
ride 7.8
course 7.7
journey 7.5
human 7.5
traditional 7.5
silhouette 7.4
symbol 7.4
design 7.3
transport 7.3
tourist 7.2
national 7.2
work 7.1

Google
created on 2022-01-15

Dress 88.7
Font 76.5
Event 72.6
Suit 71.1
Monochrome 70.8
Monochrome photography 70.4
Photo caption 65
Uniform 64.5
Team 64.3
History 63.9
Pole 62.7
Stock photography 62
Room 61.6
Symmetry 60.1
Vintage clothing 59.8
Class 56
Crew 54.4
Rectangle 53.7

Microsoft
created on 2022-01-15

text 99.1
posing 92.5
dance 90.5
person 88.4
clothing 82.5
standing 81.3
group 79.1
team 58
old 44.3
dressed 39.2
clothes 25.5

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 93.8%
Fear 65.4%
Disgusted 22.7%
Confused 4.2%
Surprised 2.6%
Sad 1.7%
Angry 1.5%
Calm 1%
Happy 0.8%

AWS Rekognition

Age 48-56
Gender Male, 69.9%
Calm 47.4%
Happy 35.5%
Fear 8.2%
Sad 3.2%
Disgusted 2.8%
Angry 1.1%
Confused 1%
Surprised 0.9%

AWS Rekognition

Age 20-28
Gender Female, 89.3%
Calm 50.6%
Sad 32%
Fear 9.4%
Disgusted 2.3%
Confused 2.1%
Happy 1.7%
Surprised 1.1%
Angry 0.7%

AWS Rekognition

Age 37-45
Gender Female, 89.6%
Calm 37.1%
Fear 36.1%
Happy 7.8%
Sad 6.7%
Confused 4.1%
Angry 3.3%
Surprised 2.6%
Disgusted 2.3%

AWS Rekognition

Age 26-36
Gender Female, 96.9%
Happy 49.9%
Calm 35.9%
Fear 11.4%
Angry 0.9%
Sad 0.7%
Disgusted 0.5%
Confused 0.4%
Surprised 0.3%

AWS Rekognition

Age 31-41
Gender Male, 91.3%
Calm 91.9%
Happy 6.2%
Surprised 0.9%
Sad 0.3%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Female, 97.7%
Calm 95.2%
Happy 2.1%
Sad 0.9%
Confused 0.8%
Surprised 0.4%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Female, 92.2%
Happy 95.5%
Sad 1.1%
Angry 0.9%
Calm 0.8%
Disgusted 0.7%
Confused 0.5%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 80.6%
Confused 7.2%
Sad 5.3%
Surprised 2.3%
Happy 2.2%
Disgusted 1.2%
Angry 1%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Happy 57.7%
Calm 22.4%
Angry 5.1%
Sad 4.9%
Surprised 3.1%
Confused 2.8%
Disgusted 2.3%
Fear 1.8%

AWS Rekognition

Age 40-48
Gender Male, 92.8%
Calm 99.1%
Happy 0.2%
Angry 0.2%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 98.2%
Calm 78.2%
Confused 8.7%
Sad 7.1%
Happy 2.6%
Surprised 1.3%
Disgusted 1%
Fear 0.6%
Angry 0.5%

AWS Rekognition

Age 24-34
Gender Male, 74.4%
Calm 49.1%
Fear 31.7%
Happy 11.6%
Disgusted 4.8%
Sad 0.9%
Confused 0.8%
Surprised 0.6%
Angry 0.5%

AWS Rekognition

Age 29-39
Gender Female, 71.7%
Sad 90.3%
Calm 3%
Happy 2.6%
Fear 1.1%
Angry 1%
Confused 1%
Disgusted 0.8%
Surprised 0.4%

AWS Rekognition

Age 35-43
Gender Male, 99.5%
Calm 41.1%
Happy 33.2%
Sad 11.7%
Confused 5.3%
Angry 3.4%
Surprised 2.9%
Disgusted 1.8%
Fear 0.8%

AWS Rekognition

Age 54-64
Gender Male, 100%
Calm 92.1%
Happy 1.8%
Surprised 1.8%
Disgusted 1.8%
Confused 0.9%
Sad 0.7%
Fear 0.6%
Angry 0.3%

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Calm 58.4%
Confused 9.9%
Sad 9.2%
Happy 6.5%
Surprised 6.3%
Disgusted 3.9%
Fear 3.4%
Angry 2.2%

AWS Rekognition

Age 40-48
Gender Male, 83.5%
Confused 26.7%
Sad 26.1%
Fear 24.3%
Surprised 8.4%
Calm 7.6%
Happy 3.9%
Disgusted 2%
Angry 1.1%

AWS Rekognition

Age 20-28
Gender Female, 95.1%
Calm 98.9%
Sad 0.6%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 99.1%
Calm 91.7%
Sad 6%
Happy 0.7%
Fear 0.7%
Angry 0.3%
Confused 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Calm 92%
Happy 4.2%
Fear 1.3%
Sad 0.9%
Confused 0.5%
Surprised 0.5%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Calm 80.7%
Happy 10.9%
Surprised 2.7%
Disgusted 2.5%
Sad 1.3%
Confused 0.8%
Angry 0.7%
Fear 0.4%

AWS Rekognition

Age 33-41
Gender Male, 99.8%
Calm 91.6%
Happy 7.6%
Surprised 0.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 97.8%
Calm 96.6%
Happy 1.3%
Surprised 0.8%
Sad 0.6%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99.8%
Calm 98.3%
Happy 0.8%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 88.1%
Calm 99.2%
Happy 0.3%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 39-47
Gender Female, 54.6%
Calm 98.8%
Sad 0.3%
Disgusted 0.2%
Angry 0.2%
Happy 0.2%
Confused 0.1%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 7-17
Gender Female, 96.2%
Calm 43.6%
Sad 21.2%
Disgusted 14.7%
Happy 6.9%
Fear 6.9%
Angry 3.2%
Confused 2.4%
Surprised 1.1%

AWS Rekognition

Age 39-47
Gender Male, 97.7%
Calm 99.2%
Happy 0.5%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Surprised 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 85.6%
Happy 97%
Calm 0.9%
Confused 0.5%
Angry 0.4%
Fear 0.4%
Surprised 0.4%
Disgusted 0.3%
Sad 0.1%

AWS Rekognition

Age 48-54
Gender Female, 64.5%
Surprised 63%
Happy 19.6%
Calm 12.7%
Disgusted 1.7%
Angry 1.3%
Fear 0.9%
Confused 0.5%
Sad 0.3%

AWS Rekognition

Age 51-59
Gender Male, 70.7%
Calm 78.1%
Happy 15.5%
Confused 3.2%
Sad 2.1%
Surprised 0.4%
Angry 0.4%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 99.3%
Calm 62.1%
Fear 15.2%
Angry 5%
Sad 4.5%
Confused 3.8%
Happy 3.7%
Disgusted 3.2%
Surprised 2.5%

AWS Rekognition

Age 47-53
Gender Female, 98.8%
Sad 58%
Calm 13.4%
Fear 12.1%
Happy 5.3%
Surprised 3.4%
Angry 3.1%
Disgusted 3%
Confused 1.7%

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Calm 55.4%
Sad 18.9%
Happy 11.6%
Confused 6.2%
Angry 3.5%
Disgusted 1.9%
Surprised 1.5%
Fear 0.9%

AWS Rekognition

Age 23-31
Gender Female, 95.3%
Fear 41.1%
Sad 28.9%
Confused 9.6%
Calm 5.6%
Disgusted 4.8%
Angry 4.4%
Surprised 2.8%
Happy 2.8%

AWS Rekognition

Age 28-38
Gender Female, 79.1%
Happy 49.8%
Fear 23.7%
Calm 12.8%
Disgusted 7.6%
Surprised 2.1%
Confused 1.6%
Sad 1.3%
Angry 1.2%

AWS Rekognition

Age 25-35
Gender Male, 99.6%
Sad 87.4%
Happy 8%
Calm 1.8%
Disgusted 1.3%
Angry 0.5%
Fear 0.4%
Confused 0.3%
Surprised 0.2%

AWS Rekognition

Age 28-38
Gender Male, 56.2%
Calm 95.5%
Sad 3.4%
Angry 0.4%
Disgusted 0.2%
Confused 0.2%
Surprised 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 27-37
Gender Male, 51.2%
Happy 44.8%
Fear 26%
Disgusted 11%
Calm 9.3%
Sad 3.7%
Surprised 2.4%
Angry 1.9%
Confused 0.9%

AWS Rekognition

Age 41-49
Gender Male, 90.2%
Happy 48.5%
Calm 41.9%
Surprised 3.1%
Confused 2.1%
Sad 1.5%
Angry 1.5%
Disgusted 1%
Fear 0.4%

AWS Rekognition

Age 31-41
Gender Female, 98.7%
Happy 87.4%
Surprised 4.5%
Calm 2.6%
Confused 2.3%
Sad 2%
Fear 0.5%
Angry 0.4%
Disgusted 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.3%
Tie 98.8%

Captions

Microsoft

a group of people posing for a photo 93.7%
a group of people posing for the camera 93.6%
a group of people posing for a picture 93.5%

Text analysis

Amazon

60639.

Google

60639.
60639.