Human Generated Data

Title

Untitled (group portrait of women on drill team in costume)

Date

c. 1948

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19123

Human Generated Data

Title

Untitled (group portrait of women on drill team in costume)

People

Artist: Robert Burian, American active 1940s-1950s

Date

c. 1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 98.9
Human 98.9
Person 98.8
Clothing 98.3
Apparel 98.3
Person 97.9
Shorts 97.8
Person 97.7
Person 96.8
Person 96.1
Person 94.4
Person 94.2
Person 94
Person 92.8
Person 89.5
Person 87.8
Person 87.5
People 85.8
Stage 84.5
Female 82.2
Person 78.7
Person 77.2
Person 73.7
Chair 72.1
Furniture 72.1
Coat 72
Suit 72
Overcoat 72
Flag 72
Symbol 72
Person 69.8
Woman 64.3
Crowd 63.7
Dress 58.4
Chair 58
Leisure Activities 56.1
Skirt 55.3

Imagga
created on 2022-03-05

dancer 41.8
people 37.4
person 32.2
performer 31
group 30.6
women 26.9
silhouette 24
entertainer 23.5
adult 21.2
crowd 21.1
men 20.6
city 18.3
business 17.6
man 17.5
runner 17.2
body 16.8
athlete 16.7
black 16.6
urban 15.7
fashion 14.3
male 14.2
team 13.4
walk 13.3
dance 12.6
happy 12.5
businessman 12.4
walking 12.3
sport 12.1
human 12
girls 11.8
clothing 11.8
silhouettes 11.6
lifestyle 11.6
fun 11.2
motion 11.1
portrait 11
move 10.5
sexy 10.4
pose 10
professional 9.8
building 9.8
train 9.6
world 9.4
model 9.3
travel 9.2
classroom 9.1
modern 9.1
teacher 9.1
figure 9.1
dress 9
success 8.8
together 8.8
contestant 8.7
room 8.7
standing 8.7
friends 8.5
active 8.4
teamwork 8.3
station 8
window 7.8
scene 7.8
corporate 7.7
sitting 7.7
casual 7.6
elegance 7.6
legs 7.5
friendship 7.5
educator 7.5
reflection 7.5
hall 7.4
street 7.4
speed 7.3
competition 7.3
design 7.3
transport 7.3
indoor 7.3
art 7.3
businesswoman 7.3
celebration 7.2
transportation 7.2
holiday 7.2
posing 7.1

Google
created on 2022-03-05

Font 76.5
Event 70.9
Monochrome 70.8
Crew 70.2
Monochrome photography 65.4
History 63
Uniform 62.7
Team 62.1
Room 59.6
Art 59.2
Vintage clothing 55.8
Visual arts 53.5
Symmetry 51.9

Microsoft
created on 2022-03-05

person 93
clothing 91.7
text 91.1
footwear 90.6
group 85.7
dance 81.5
woman 55.6
posing 53.1

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 100%
Fear 40.8%
Sad 27.5%
Happy 15.1%
Calm 4.8%
Confused 4.4%
Disgusted 3.7%
Surprised 2.3%
Angry 1.2%

AWS Rekognition

Age 33-41
Gender Male, 98.2%
Happy 45.1%
Confused 19.5%
Calm 13.1%
Surprised 9.3%
Sad 6.9%
Disgusted 3%
Angry 2.2%
Fear 0.9%

AWS Rekognition

Age 30-40
Gender Male, 100%
Happy 55%
Calm 42.1%
Surprised 1%
Sad 0.5%
Disgusted 0.4%
Fear 0.4%
Angry 0.4%
Confused 0.2%

AWS Rekognition

Age 45-51
Gender Male, 99.4%
Calm 68.7%
Fear 11.5%
Happy 10.1%
Sad 4.6%
Confused 3%
Surprised 1%
Disgusted 0.8%
Angry 0.5%

AWS Rekognition

Age 29-39
Gender Male, 89.3%
Happy 68.8%
Surprised 9.6%
Disgusted 6.1%
Sad 4.9%
Confused 4.7%
Calm 3.6%
Angry 1.5%
Fear 0.8%

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Calm 90.9%
Sad 4.5%
Confused 2.6%
Fear 0.8%
Disgusted 0.3%
Surprised 0.3%
Angry 0.3%
Happy 0.3%

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Happy 81.5%
Calm 10.6%
Surprised 3.1%
Fear 2%
Confused 1.1%
Disgusted 0.9%
Angry 0.5%
Sad 0.3%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 98.2%
Surprised 1%
Happy 0.3%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 91.9%
Happy 2.5%
Surprised 1.9%
Confused 1.9%
Disgusted 0.9%
Sad 0.4%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Happy 65.7%
Surprised 17.6%
Calm 12.8%
Confused 1.4%
Disgusted 1.1%
Sad 0.9%
Angry 0.4%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 98.9%
Chair 72.1%
Flag 72%

Captions

Microsoft

a group of people posing for a photo 94.2%
a group of people posing for the camera 94.1%
a group of people posing for a picture 94%

Text analysis

Amazon

DSS
153
DSS 153
MJ17
MJ17 YT3RAS
YT3RAS

Google

YT33A2
DSS
M.I13 YT33A2 032MA DSS 158 DSS
M.I13
158
032MA